00000001:02000400:0.0F:1787823319.176682:0:2959:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg235-server.virtnet: executing set_hostid 00000001:02000400:0.0:1787823340.846299:0:3181:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg235-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1787823343.028965:0:3241:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 575 MB/s 00000001:01000000:3.0F:1787823343.279094:0:3241:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 775 MB/s 00000001:01000000:0.0:1787823343.528845:0:3241:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4291 MB/s 00000020:02000000:2.0:1787823344.622382:0:3274:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_80_g0325ae4 00000400:02000000:3.0:1787823345.910783:0:3289:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.202.135@tcp [8/256/0/180] 00008000:02000000:1.0F:1787823349.860387:0:3439:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1787823405.355098:0:5242:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg235-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787823415.470027:0:5819:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787823415.470032:0:5819:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787823415.470129:0:5819:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000006d8917cf 00000080:02000400:2.0:1787823415.470137:0:5819:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1787823415.474123:0:5819:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1787823415.474139:0:5819:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787823415.474178:0:5819:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000004bece2d7) 00000020:00000080:2.0:1787823415.474193:0:5819:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787823415.488089:0:5819:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1787823415.488490:0:5819:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1787823415.527108:0:5819:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1787823415.527131:0:5819:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787823415.527143:0:5819:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1787823415.527172:0:5819:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787823415.527185:0:5819:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1787823415.527623:0:5819:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1787823415.527630:0:5819:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787823415.527643:0:5819:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d1142b8324813c2 00000020:01000004:1.0:1787823415.527650:0:5819:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1787823415.527654:0:5819:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1787823415.527659:0:5819:0:(tgt_mount.c:101:server_register_mount()) register mount 000000006d8917cf from MGS 00000020:01000004:1.0:1787823415.527664:0:5819:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1787823415.527683:0:5819:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000080b7ccd3) 00000020:00000080:1.0:1787823415.527694:0:5819:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787823415.527951:0:5819:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006d8917cf from MGS, refs=2 00080000:01000000:2.0:1787823415.527956:0:5819:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787823415.527962:0:5819:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d1142b8324813d0 00000100:00100000:2.0:1787823415.528083:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787823415.528227:0:5819:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787823415.528234:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787823415.529514:0:5819:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787823415.529525:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787823415.531227:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787823415.531539:0:5819:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787823415.531545:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787823415.532354:0:5819:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787823415.532382:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787823415.533216:0:5819:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787823415.533225:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787823415.534183:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823415.534186:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823415.534188:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823415.534488:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823415.534491:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823415.534493:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823415.536567:0:5819:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787823415.543112:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1787823415.792026:0:5819:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2250 MB/s 00000001:01000000:2.0:1787823416.042163:0:5819:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3039 MB/s 00000001:01000000:0.0:1787823416.292862:0:5819:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 446 MB/s 00000001:01000000:3.0:1787823416.543160:0:5819:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 379 MB/s 00010000:00010000:0.0:1787823416.553875:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1787823416.578223:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1787823416.636024:0:5819:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1787823416.636052:0:5819:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787823416.636055:0:5819:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1787823416.641946:0:5829:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787823416.643387:0:5819:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787823416.643439:0:5819:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1787823416.643653:0:5819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787823416.643674:0:5819:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787823416.644010:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787823416.644156:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787823416.644161:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787823416.651590:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787823416.651605:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787823416.657983:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787823416.658001:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787823416.664745:0:5819:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787823416.664816:0:5819:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.135@tcp' 00000020:01000004:3.0:1787823416.664818:0:5819:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787823416.664865:0:5819:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.135@tcp (typ=mgc) 00000020:00000080:3.0:1787823416.664888:0:5819:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.135@tcp (0000000026c668fe) 00000020:00000080:3.0:1787823416.664905:0:5819:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787823416.665023:0:5819:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000153c6797@MGC192.168.202.135@tcp: add connection 192.168.202.135@tcp at head 00010000:00010000:3.0:1787823416.665413:0:5819:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.135@tcp-0 is initialized 00000040:01000000:3.0:1787823416.665421:0:5819:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.135@tcp ctxt 1 is initialized 00000100:00080000:1.0:1787823416.666187:0:5834:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1787823416.668051:0:5835:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787823416.669351:0:5819:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.135@tcp (uuid 08ea8b37-2f3c-43db-8113-f3cf41ba8d24) 00000020:00000080:3.0:1787823416.669387:0:5819:0:(genops.c:1385:class_connect()) connect: client 08ea8b37-2f3c-43db-8113-f3cf41ba8d24, cookie 0x5d1142b8324813de 00000100:00080000:3.0:1787823416.669402:0:5819:0:(import.c:510:import_select_connection()) MGC192.168.202.135@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787823416.669408:0:5819:0:(import.c:624:import_select_connection()) MGC192.168.202.135@tcp: import 00000000153c6797 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:3.0:1787823416.669446:0:5819:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d9a3e263 x1874668651806848/t0(0) o250->MGC192.168.202.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787823416.669468:0:5819:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 08ea8b37-2f3c-43db-8113-f3cf41ba8d24->MGS 00000020:01000004:3.0:1787823416.669484:0:5819:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787823416.669489:0:5819:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787823416.669502:0:5819:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000001b4f5da1) 00000020:00000080:3.0:1787823416.669515:0:5819:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787823416.679744:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9a3e263 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3304:1874668651806848:0@lo:250: 00000100:00100000:0.0:1787823416.679839:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823416.680429:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651806848 00000100:00100000:2.0:1787823416.680438:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651806848 00000100:00100000:2.0:1787823416.680480:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787823416.680487:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a670715c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3304:x1874668651806848:12345-0@lo:250: 00010000:00080000:2.0:1787823416.680513:0:5831:0:(ldlm_lib.c:1454:target_handle_connect()) MGS: connection from 08ea8b37-2f3c-43db-8113-f3cf41ba8d24@0@lo t0 exp 0000000000000000 cur 157 last 0 00000020:00000080:2.0:1787823416.680540:0:5831:0:(genops.c:1385:class_connect()) connect: client 08ea8b37-2f3c-43db-8113-f3cf41ba8d24, cookie 0x5d1142b8324813ec 00000100:00080000:2.0:1787823416.680689:0:5831:0:(import.c:65:import_set_state_nolock()) 0000000033b09d8f : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787823416.683964:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a670715c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+5:3304:x1874668651806848:12345-0@lo:250: Request processed in 3469us (4118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823416.683980:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787823416.684071:0:3304:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.135@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787823416.684082:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.135@tcp: connect to target with instance 0 00000100:00080000:2.0:1787823416.684089:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.135@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787823416.684094:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787823416.684099:0:3304:0:(import.c:65:import_set_state_nolock()) 00000000153c6797 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787823416.684102:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787823416.684119:0:3304:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787823416.684124:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9a3e263 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3304:1874668651806848:0@lo:250: 00000100:00100000:3.0:1787823416.696472:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787823416.696686:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787823416.696694:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787823416.700609:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787823416.700621:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787823416.701442:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787823416.701451:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787823416.702405:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787823416.702578:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787823416.702583:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787823416.706135:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787823416.706158:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787823416.839391:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787823416.839683:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787823416.839690:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787823416.842617:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787823416.842630:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787823416.843445:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787823416.843657:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787823416.843662:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787823416.844440:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787823416.844447:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787823416.845706:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787823416.848260:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787823416.848277:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787823416.863529:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787823416.863551:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787823416.868154:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787823416.868345:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787823416.868353:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787823416.871575:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787823416.871600:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787823416.922194:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787823416.924001:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787823416.924022:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787823416.929285:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787823416.929306:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787823416.931198:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787823416.931214:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787823416.939002:0:5819:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787823416.939034:0:5819:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1787823416.939040:0:5819:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.135@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787823416.939167:0:5819:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.135@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787823416.939206:0:5819:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.135@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1787823416.939211:0:5819:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787823416.939213:0:5819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787823416.939214:0:5819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787823416.939215:0:5819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787823416.939216:0:5819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787823416.939218:0:5819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787823416.939219:0:5819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787823416.939220:0:5819:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787823416.939222:0:5819:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787823416.939223:0:5819:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787823416.939224:0:5819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787823416.939225:0:5819:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787823416.939227:0:5819:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1787823416.939230:0:5819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787823416.939231:0:5819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787823416.939232:0:5819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787823416.939233:0:5819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787823416.939234:0:5819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787823416.939235:0:5819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787823416.939236:0:5819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787823416.939237:0:5819:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787823416.939238:0:5819:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787823416.939239:0:5819:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787823416.939239:0:5819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787823416.939241:0:5819:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787823416.939275:0:5819:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787823416.939293:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b5d39ae5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5819:1874668651806976:0@lo:253: 00000100:00100000:1.0:1787823416.939383:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823416.939492:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 0000000068d18754 going to sleep for 11 seconds 00000100:00100000:1.0:1787823416.945251:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651806976 00000100:00100000:1.0:1787823416.945270:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651806976 00000100:00100000:1.0:1787823416.945341:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787823416.945350:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000298a4bc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+5:5819:x1874668651806976:12345-0@lo:253: 20000000:01000000:1.0:1787823416.945427:0:5833:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787823416.945430:0:5833:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1787823416.945986:0:5854:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787823416.946056:0:5833:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1787823416.946334:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787823416.947185:0:5855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1787823416.947550:0:5833:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787823416.947556:0:5833:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1787823416.947564:0:5833:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1787823416.947567:0:5833:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1787823416.947584:0:5833:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1787823416.947832:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787823416.948068:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1787823416.948080:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787823416.948132:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1787823416.948181:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1787823416.948220:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1787823416.948305:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1787823416.948313:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1787823416.948368:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1787823416.948376:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1787823416.948409:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1787823416.948416:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1787823416.948464:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1787823416.948512:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1787823416.948541:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787823416.948546:0:5833:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1787823416.948559:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787823416.948781:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1787823416.948790:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787823416.948820:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1787823416.948846:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1787823416.948883:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1787823416.948892:0:5833:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1787823416.948953:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1787823416.948961:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787823416.948995:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1787823416.949032:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1787823416.949060:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1787823416.949070:0:5833:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1787823416.949148:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1787823416.949155:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1787823416.949181:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1787823416.949207:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1787823416.949331:0:5833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1787823416.949381:0:5833:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1787823416.949389:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1787823416.955239:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1787823416.955653:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1787823416.955693:0:5833:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.135@tcp for mdt 20000000:01000000:1.0:1787823416.955696:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.135@tcp (null) (null) (null) 00000040:00080000:1.0:1787823416.955748:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1787823416.955786:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787823416.955820:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1787823416.955828:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.135@tcp (null) (null) 00000040:00080000:1.0:1787823416.955900:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1787823416.955911:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1787823416.955943:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1787823416.955977:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1787823416.956041:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787823416.956044:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787823416.956048:0:5833:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787823416.956059:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787823416.956061:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787823416.956092:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787823416.956095:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787823416.958262:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1787823416.958579:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1787823416.958625:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1787823416.958713:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:1.0:1787823416.958750:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787823416.958752:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787823416.963168:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1787823416.969521:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1787823416.969575:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1787823416.969608:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1787823416.969622:0:5833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787823416.969626:0:5833:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1787823416.969631:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787823416.969633:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787823416.969638:0:5833:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1787823416.969644:0:5833:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1787823416.976295:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1787823416.976477:0:5833:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1787823416.997287:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1787823416.997341:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1787823416.997428:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1787823416.997449:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787823416.997470:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008267b80e/0x5d1142b8324813f3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823416.997488:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008267b80e/0x5d1142b8324813f3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823416.999892:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008267b80e/0x5d1142b8324813f3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823416.999927:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008267b80e/0x5d1142b8324813f3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823416.999934:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008267b80e/0x5d1142b8324813f3 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823416.999967:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008267b80e/0x5d1142b8324813f3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823416.999973:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008267b80e already unused, calling callback (00000000b5a64369) 00010000:00010000:1.0:1787823416.999976:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008267b80e/0x5d1142b8324813f3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823416.999985:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008267b80e/0x5d1142b8324813f3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823417.000000:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008267b80e/0x5d1142b8324813f3 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823417.000009:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008267b80e/0x5d1142b8324813f3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823417.000015:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008267b80e/0x5d1142b8324813f3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787823417.000041:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787823417.412610:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000298a4bc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+5:5819:x1874668651806976:12345-0@lo:253: Request processed in 467252us (473218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823417.412626:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787823417.412821:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b5d39ae5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5819:1874668651806976:0@lo:253: 10000000:01000000:1.0:1787823417.412836:0:5819:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787823417.412839:0:5819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787823417.412841:0:5819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787823417.412843:0:5819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787823417.412844:0:5819:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1787823417.412845:0:5819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787823417.412847:0:5819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787823417.412848:0:5819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787823417.412849:0:5819:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787823417.412851:0:5819:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787823417.412868:0:5819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787823417.412869:0:5819:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787823417.412887:0:5819:0:(tgt_mount.c:101:server_register_mount()) register mount 000000006d8917cf from lustre-MDT0000 10000000:01000000:1.0:1787823417.412911:0:5819:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787823417.412914:0:5819:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787823417.412917:0:5819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8e7906ef0000 10000000:01000000:1.0:1787823417.412922:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787823417.412930:0:5819:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e7906ef0000 from 1 10000000:01000000:1.0:1787823417.412933:0:5819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787823417.412968:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: 000000008267b80e/0x5d1142b8324813fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823417.412978:0:5819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: 000000008267b80e/0x5d1142b8324813fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823417.412986:0:5819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: 000000008267b80e/0x5d1142b8324813fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823417.413002:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b5d39ae5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5819:1874668651807104:0@lo:101: 00000100:00100000:1.0:1787823417.413037:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823417.413084:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b83c6766 going to sleep for 11 seconds 00000100:00100000:2.0:1787823417.413458:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651807104 00000100:00100000:2.0:1787823417.413465:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651807104 00000100:00100000:2.0:1787823417.413528:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787823417.413537:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e47cad8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+5:5819:x1874668651807104:12345-0@lo:101: 00010000:00010000:2.0:1787823417.413560:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823417.413577:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000041a8bd26/0x5d1142b832481401 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b8324813fa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823417.413600:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000041a8bd26/0x5d1142b832481401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b8324813fa expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823417.413609:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000041a8bd26/0x5d1142b832481401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b8324813fa expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823417.413618:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000041a8bd26, rc 0) 00000100:00100000:2.0:1787823417.413651:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e47cad8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+6:5819:x1874668651807104:12345-0@lo:101: Request processed in 116us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823417.413657:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787823417.414216:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b5d39ae5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5819:1874668651807104:0@lo:101: 00010000:00010000:1.0:1787823417.414235:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: 000000008267b80e/0x5d1142b8324813fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481401 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823417.414243:0:5819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: 000000008267b80e/0x5d1142b8324813fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b832481401 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823417.414652:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b5d39ae5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5819:1874668651807232:0@lo:501: 00000100:00100000:1.0:1787823417.414696:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823417.415003:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b83c6766 going to sleep for 11 seconds 00000100:00100000:2.0:1787823417.415131:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651807232 00000100:00100000:2.0:1787823417.415137:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651807232 00000100:00100000:2.0:1787823417.415179:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787823417.415187:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5c29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+6:5819:x1874668651807232:12345-0@lo:501: 00000100:00100000:2.0:1787823417.415512:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5c29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+6:5819:x1874668651807232:12345-0@lo:501: Request processed in 325us (816us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787823417.415521:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787823417.415743:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b5d39ae5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5819:1874668651807232:0@lo:501: 10000000:01000000:3.0:1787823417.415817:0:5819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787823417.415833:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: 000000008267b80e/0x5d1142b8324813fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481401 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823417.415842:0:5819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: 000000008267b80e/0x5d1142b8324813fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481401 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787823417.415852:0:5819:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e79034dc800 10000000:01000000:3.0:1787823417.415858:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787823417.415863:0:5819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8e79034dc800 10000000:01000000:3.0:1787823417.415865:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787823417.415868:0:5819:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8e79034dc800 from 1 10000000:01000000:3.0:1787823417.415871:0:5819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787823417.415901:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: 0000000083e5076a/0x5d1142b832481408 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823417.415908:0:5819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: 0000000083e5076a/0x5d1142b832481408 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823417.415926:0:5819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: 0000000083e5076a/0x5d1142b832481408 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823417.415940:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fe1f47ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5819:1874668651807360:0@lo:101: 00000100:00100000:3.0:1787823417.415998:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823417.416031:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 000000008d772f79 going to sleep for 11 seconds 00000100:00100000:0.0:1787823417.416199:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651807360 00000100:00100000:0.0:1787823417.416204:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651807360 00000100:00100000:0.0:1787823417.416247:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787823417.416253:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ac1a2b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+6:5819:x1874668651807360:12345-0@lo:101: 00010000:00010000:0.0:1787823417.416262:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823417.416275:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c42492de/0x5d1142b83248140f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b832481408 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823417.416303:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c42492de/0x5d1142b83248140f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b832481408 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823417.416312:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c42492de/0x5d1142b83248140f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832481408 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823417.416321:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c42492de, rc 0) 00000100:00100000:0.0:1787823417.416364:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ac1a2b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+7:5819:x1874668651807360:12345-0@lo:101: Request processed in 111us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823417.416370:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787823417.416726:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fe1f47ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5819:1874668651807360:0@lo:101: 00010000:00010000:3.0:1787823417.416738:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: 0000000083e5076a/0x5d1142b832481408 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248140f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823417.416746:0:5819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: 0000000083e5076a/0x5d1142b832481408 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b83248140f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787823417.417006:0:5819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787823417.417017:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: 0000000083e5076a/0x5d1142b832481408 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248140f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823417.417024:0:5819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: 0000000083e5076a/0x5d1142b832481408 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248140f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787823417.417030:0:5819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787823417.417035:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787823417.417040:0:5819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8e79034dc800 10000000:01000000:3.0:1787823417.417042:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787823417.417046:0:5819:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787823417.417048:0:5819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787823417.417067:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: 0000000076ad0d6e/0x5d1142b832481416 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823417.417083:0:5819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: 0000000076ad0d6e/0x5d1142b832481416 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823417.417090:0:5819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: 0000000076ad0d6e/0x5d1142b832481416 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823417.417103:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fe1f47ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5819:1874668651807488:0@lo:101: 00000100:00100000:3.0:1787823417.417137:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823417.417169:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 000000008d772f79 going to sleep for 11 seconds 00000100:00100000:0.0:1787823417.417230:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651807488 00000100:00100000:0.0:1787823417.417235:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651807488 00000100:00100000:0.0:1787823417.417268:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787823417.417274:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6a5d727 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+7:5819:x1874668651807488:12345-0@lo:101: 00010000:00010000:0.0:1787823417.417295:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823417.417305:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000043680a3e/0x5d1142b83248141d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b832481416 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823417.417335:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000043680a3e/0x5d1142b83248141d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b832481416 expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823417.417344:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000043680a3e/0x5d1142b83248141d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832481416 expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823417.417360:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000043680a3e, rc 0) 00000100:00100000:0.0:1787823417.417393:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6a5d727 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+8:5819:x1874668651807488:12345-0@lo:101: Request processed in 119us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823417.417399:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787823417.417640:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fe1f47ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5819:1874668651807488:0@lo:101: 00010000:00010000:3.0:1787823417.417651:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: 0000000076ad0d6e/0x5d1142b832481416 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248141d expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823417.417658:0:5819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: 0000000076ad0d6e/0x5d1142b832481416 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b83248141d expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823417.417720:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fe1f47ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5819:1874668651807616:0@lo:501: 00000100:00100000:3.0:1787823417.417747:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823417.418063:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 000000008d772f79 going to sleep for 11 seconds 00000100:00100000:1.0:1787823417.419614:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651807616 00000100:00100000:1.0:1787823417.419629:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651807616 00000100:00100000:1.0:1787823417.420010:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787823417.420020:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005515c425 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+8:5819:x1874668651807616:12345-0@lo:501: 00000100:00100000:1.0:1787823417.420331:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005515c425 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+9:5819:x1874668651807616:12345-0@lo:501: Request processed in 312us (2584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823417.420339:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787823417.420632:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fe1f47ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5819:1874668651807616:0@lo:501: 00000100:00100000:2.0:1787823417.420688:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000048f3d261 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5819:1874668651807744:0@lo:503: 00000100:00100000:2.0:1787823417.420751:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823417.421048:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 000000001dcce372 going to sleep for 11 seconds 00000100:00100000:1.0:1787823417.421138:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651807744 00000100:00100000:1.0:1787823417.421143:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651807744 00000100:00100000:1.0:1787823417.421179:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787823417.421186:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000928445e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+9:5819:x1874668651807744:12345-0@lo:503: 00000100:00100000:1.0:1787823417.421500:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000928445e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+9:5819:x1874668651807744:12345-0@lo:503: Request processed in 308us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823417.421508:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787823417.421645:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000048f3d261 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5819:1874668651807744:0@lo:503: 00000100:00100000:1.0:1787823417.422301:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b5d39ae5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5861:1874668651807872:0@lo:502: 00000100:00100000:1.0:1787823417.422361:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823417.422393:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set 000000005fcf3f3e going to sleep for 11 seconds 00000100:00100000:0.0:1787823417.422523:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651807872 00000100:00100000:0.0:1787823417.422528:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651807872 00000100:00100000:0.0:1787823417.422567:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787823417.422575:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001987e042 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+9:5861:x1874668651807872:12345-0@lo:502: 00000100:00100000:2.0:1787823417.423174:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b5d39ae5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5861:1874668651807872:0@lo:502: 00000020:01000000:2.0:1787823417.423216:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787823417.423227:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787823417.423230:0:5861:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787823417.423236:0:5861:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787823417.423239:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787823417.423253:0:5861:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000009ab8355d) 00000020:00000080:2.0:1787823417.423275:0:5861:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787823417.423280:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787823417.423372:0:5861:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787823417.423392:0:5861:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d1142b83248142b 00000020:00000080:2.0:1787823417.423661:0:5861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787823417.423666:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787823417.423670:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787823417.423672:0:5861:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787823417.423674:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787823417.423677:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787823417.423679:0:5861:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787823417.423682:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787823417.423689:0:5861:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000036b216bf) 00000020:00000080:2.0:1787823417.423700:0:5861:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787823417.423704:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787823417.423705:0:5861:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787823417.426037:0:5861:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787823417.426065:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787823417.426167:0:5861:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006d8917cf from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787823417.426188:0:5861:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000005c26ece1) 00000020:00000080:2.0:1787823417.426202:0:5861:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787823417.426249:0:5861:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787823417.426257:0:5861:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d1142b832481440 00000020:00000080:2.0:1787823417.426405:0:5861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787823417.426412:0:5861:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787823417.426417:0:5861:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5d1142b832481447 00080000:01000000:2.0:1787823417.426422:0:5861:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787823417.426438:0:5861:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d1142b83248144e 00000100:00100000:0.0:1787823417.428056:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001987e042 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+9:5861:x1874668651807872:12345-0@lo:502: Request processed in 5474us (5698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823417.428072:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00080000:10000000:2.0:1787823417.430042:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1787823417.430436:0:5861:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1787823417.439062:0:5861:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787823417.584421:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823417.615033:0:5861:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1787823417.616365:0:5861:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1787823417.618326:0:5861:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1787823417.618605:0:5861:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787823417.688106:0:5861:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000006ac4c6b4) 00000020:00000080:3.0:1787823417.688148:0:5861:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787823417.688249:0:5861:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787823417.688256:0:5861:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d1142b83248145c 00000020:00000080:0.0:1787823417.691091:0:5861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1787823417.701273:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787823417.786436:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787823417.828262:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787823417.873118:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787823417.961178:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787823418.003392:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1787823418.047970:0:5861:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5d1142b832481463 00000020:00000080:1.0:1787823418.048590:0:5861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787823418.048601:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787823418.048608:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787823418.048610:0:5861:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787823418.048613:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787823418.048617:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787823418.048618:0:5861:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787823418.048621:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787823418.048622:0:5861:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787823418.048641:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787823418.048645:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787823418.048646:0:5861:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787823418.048648:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787823418.048652:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787823418.048653:0:5861:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787823418.048657:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787823418.048702:0:5861:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1787823418.048942:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a859e23e pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5861:1874668651808000:0@lo:502: 00000100:00100000:1.0:1787823418.049020:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823418.049065:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set 0000000021b8fd94 going to sleep for 11 seconds 00000100:00100000:2.0:1787823418.049239:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651808000 00000100:00100000:2.0:1787823418.049247:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651808000 00000100:00100000:2.0:1787823418.049295:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787823418.049303:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dcf5be34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+9:5861:x1874668651808000:12345-0@lo:502: 00000100:00100000:2.0:1787823418.049654:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dcf5be34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+9:5861:x1874668651808000:12345-0@lo:502: Request processed in 350us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823418.049662:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787823418.049934:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a859e23e pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5861:1874668651808000:0@lo:502: 00000020:01000000:2.0:1787823418.049967:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787823418.049972:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787823418.049974:0:5861:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1787823418.049977:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1787823418.050091:0:5819:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1787823418.050110:0:5819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787823418.050193:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: 0000000076ad0d6e/0x5d1142b832481416 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248141d expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823418.050206:0:5819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: 0000000076ad0d6e/0x5d1142b832481416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248141d expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787823418.050214:0:5819:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e79034dc800 from 1 10000000:01000000:2.0:1787823418.050226:0:5819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787823418.050258:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: 000000003ff6b1e7/0x5d1142b83248146a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823418.050266:0:5819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: 000000003ff6b1e7/0x5d1142b83248146a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823418.050273:0:5819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: 000000003ff6b1e7/0x5d1142b83248146a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823418.050288:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000048f3d261 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5819:1874668651808128:0@lo:101: 00000100:00100000:2.0:1787823418.050319:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823418.050354:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cfd6a928 going to sleep for 11 seconds 00000100:00100000:1.0:1787823418.050425:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651808128 00000100:00100000:1.0:1787823418.050430:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651808128 00000100:00100000:1.0:1787823418.050462:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787823418.050469:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc5b56c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+9:5819:x1874668651808128:12345-0@lo:101: 00010000:00010000:1.0:1787823418.050479:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823418.050502:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a9c562ea/0x5d1142b832481471 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b83248146a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823418.050524:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a9c562ea/0x5d1142b832481471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b83248146a expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823418.050534:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a9c562ea/0x5d1142b832481471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b83248146a expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823418.050543:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a9c562ea, rc 0) 00000100:00100000:1.0:1787823418.050573:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc5b56c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+10:5819:x1874668651808128:12345-0@lo:101: Request processed in 105us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823418.050579:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787823418.050886:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000048f3d261 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5819:1874668651808128:0@lo:101: 00010000:00010000:2.0:1787823418.050901:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: 000000003ff6b1e7/0x5d1142b83248146a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481471 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823418.050908:0:5819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: 000000003ff6b1e7/0x5d1142b83248146a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b832481471 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823418.052058:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000048f3d261 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5819:1874668651808256:0@lo:256: 00000100:00100000:2.0:1787823418.052255:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823418.052333:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cfd6a928 going to sleep for 11 seconds 00000100:00100000:1.0:1787823418.052442:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651808256 00000100:00100000:1.0:1787823418.052456:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651808256 00000100:00100000:1.0:1787823418.052600:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787823418.052610:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1969f4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+10:5819:x1874668651808256:12345-0@lo:256: 20000000:01000000:1.0:1787823418.052637:0:5833:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787823418.052643:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787823418.052733:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1969f4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+10:5819:x1874668651808256:12345-0@lo:256: Request processed in 126us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823418.052741:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787823418.052849:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000048f3d261 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5819:1874668651808256:0@lo:256: 10000000:01000000:2.0:1787823418.053446:0:5819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787823418.054979:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: 000000003ff6b1e7/0x5d1142b83248146a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481471 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823418.054998:0:5819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: 000000003ff6b1e7/0x5d1142b83248146a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481471 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787823418.055027:0:5819:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e79034dc800 from 1 10000000:01000000:2.0:1787823418.055029:0:5819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787823418.055063:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: 000000002c754e28/0x5d1142b832481478 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823418.055068:0:5819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: 000000002c754e28/0x5d1142b832481478 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823418.055077:0:5819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: 000000002c754e28/0x5d1142b832481478 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823418.055092:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000048f3d261 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5819:1874668651808384:0@lo:101: 00000100:00100000:2.0:1787823418.055269:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823418.055310:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cfd6a928 going to sleep for 11 seconds 00000100:00100000:0.0:1787823418.055330:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651808384 00000100:00100000:0.0:1787823418.055337:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651808384 00000100:00100000:0.0:1787823418.055496:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787823418.055506:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db787e47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+10:5819:x1874668651808384:12345-0@lo:101: 00010000:00010000:0.0:1787823418.055790:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823418.055806:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fb05fada/0x5d1142b83248147f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b832481478 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823418.055830:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fb05fada/0x5d1142b83248147f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b832481478 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823418.055839:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fb05fada/0x5d1142b83248147f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832481478 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823418.055847:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fb05fada, rc 0) 00000100:00100000:0.0:1787823418.055897:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db787e47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+11:5819:x1874668651808384:12345-0@lo:101: Request processed in 393us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823418.055904:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787823418.055913:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000048f3d261 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5819:1874668651808384:0@lo:101: 00010000:00010000:2.0:1787823418.055927:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: 000000002c754e28/0x5d1142b832481478 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248147f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823418.055935:0:5819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: 000000002c754e28/0x5d1142b832481478 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b83248147f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823418.055995:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000048f3d261 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5819:1874668651808512:0@lo:501: 00000100:00100000:2.0:1787823418.056018:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823418.056045:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cfd6a928 going to sleep for 11 seconds 00000100:00100000:1.0:1787823418.056062:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651808512 00000100:00100000:1.0:1787823418.056067:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651808512 00000100:00100000:1.0:1787823418.056094:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787823418.056100:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dfdbc5a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+11:5819:x1874668651808512:12345-0@lo:501: 00000100:00100000:1.0:1787823418.056996:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dfdbc5a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+11:5819:x1874668651808512:12345-0@lo:501: Request processed in 894us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823418.057004:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787823418.057019:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000048f3d261 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5819:1874668651808512:0@lo:501: 00000100:00100000:2.0:1787823418.057052:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000048f3d261 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5819:1874668651808640:0@lo:503: 00000100:00100000:2.0:1787823418.057097:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823418.057116:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cfd6a928 going to sleep for 11 seconds 00000100:00100000:0.0:1787823418.057119:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651808640 00000100:00100000:0.0:1787823418.057124:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651808640 00000100:00100000:0.0:1787823418.057162:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787823418.057169:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c76e0eb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+11:5819:x1874668651808640:12345-0@lo:503: 00000040:00080000:0.0:1787823418.057203:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787823418.057241:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c76e0eb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+11:5819:x1874668651808640:12345-0@lo:503: Request processed in 73us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823418.057248:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787823418.057316:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000048f3d261 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5819:1874668651808640:0@lo:503: 00000040:00080000:2.0:1787823418.058416:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1787823418.058921:0:5819:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1787823418.058943:0:5819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787823418.059008:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: 000000002c754e28/0x5d1142b832481478 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248147f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823418.059020:0:5819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: 000000002c754e28/0x5d1142b832481478 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248147f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787823418.059079:0:5819:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787823418.059083:0:5819:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e79034dc800 10000000:01000000:0.0:1787823418.059086:0:5819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e79034dc800 10000000:01000000:0.0:1787823418.059090:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787823418.059095:0:5819:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e79034dc800 from 1 10000000:01000000:0.0:1787823418.059098:0:5819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787823418.059143:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: 00000000dce8dce2/0x5d1142b832481486 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823418.059151:0:5819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: 00000000dce8dce2/0x5d1142b832481486 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823418.059161:0:5819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: 00000000dce8dce2/0x5d1142b832481486 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823418.059336:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007d291008 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5819:1874668651808768:0@lo:101: 00000100:00100000:0.0:1787823418.059406:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823418.059479:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 000000009a983d5c going to sleep for 11 seconds 00000100:00100000:1.0:1787823418.059605:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651808768 00000100:00100000:1.0:1787823418.059611:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651808768 00000100:00100000:1.0:1787823418.059686:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787823418.059695:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006921223d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+11:5819:x1874668651808768:12345-0@lo:101: 00010000:00010000:1.0:1787823418.059708:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823418.059718:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cd067ff6/0x5d1142b83248148d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b832481486 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823418.059740:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cd067ff6/0x5d1142b83248148d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b832481486 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823418.059784:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cd067ff6/0x5d1142b83248148d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832481486 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823418.059804:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cd067ff6, rc 0) 00000100:00100000:1.0:1787823418.059839:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006921223d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:5819:x1874668651808768:12345-0@lo:101: Request processed in 145us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823418.059845:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787823418.059912:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007d291008 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5819:1874668651808768:0@lo:101: 00010000:00010000:0.0:1787823418.059927:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: 00000000dce8dce2/0x5d1142b832481486 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248148d expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823418.059935:0:5819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: 00000000dce8dce2/0x5d1142b832481486 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b83248148d expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823418.059979:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007d291008 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5819:1874668651808896:0@lo:501: 00000100:00100000:0.0:1787823418.060002:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823418.060395:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 000000009a983d5c going to sleep for 11 seconds 00000100:00100000:3.0:1787823418.060452:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651808896 00000100:00100000:3.0:1787823418.060456:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651808896 00000100:00100000:3.0:1787823418.060473:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787823418.060476:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff3deff1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:5819:x1874668651808896:12345-0@lo:501: 00000100:00100000:3.0:1787823418.060917:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff3deff1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:5819:x1874668651808896:12345-0@lo:501: Request processed in 437us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823418.060925:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787823418.062434:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007d291008 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5819:1874668651808896:0@lo:501: 00000100:00100000:0.0:1787823418.062490:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007d291008 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5819:1874668651809024:0@lo:503: 00000100:00100000:1.0:1787823418.063121:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823418.063165:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 000000009a983d5c going to sleep for 11 seconds 00000100:00100000:3.0:1787823418.063252:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651809024 00000100:00100000:3.0:1787823418.063257:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651809024 00000100:00100000:3.0:1787823418.063298:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787823418.063306:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003bf2f92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:5819:x1874668651809024:12345-0@lo:503: 00000100:00100000:3.0:1787823418.063650:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003bf2f92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:5819:x1874668651809024:12345-0@lo:503: Request processed in 344us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823418.063658:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787823418.063679:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007d291008 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5819:1874668651809024:0@lo:503: 00000100:00100000:1.0:1787823418.064080:0:5866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007cac5dea pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5866:1874668651809152:0@lo:502: 00000100:00100000:1.0:1787823418.064118:0:5866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823418.064241:0:5866:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b55a87ad going to sleep for 11 seconds 00000100:00100000:2.0:1787823418.064266:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651809152 00000100:00100000:2.0:1787823418.064269:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651809152 00000100:00100000:2.0:1787823418.064323:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787823418.064331:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009af60041 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:5866:x1874668651809152:12345-0@lo:502: 00000100:00100000:2.0:1787823418.064591:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009af60041 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:5866:x1874668651809152:12345-0@lo:502: Request processed in 261us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823418.064598:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787823418.064675:0:5866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007cac5dea pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5866:1874668651809152:0@lo:502: 00000020:01000004:1.0:1787823418.064722:0:5866:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787823418.064733:0:5866:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000057b61093) 00000020:00000080:1.0:1787823418.064746:0:5866:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1787823418.064835:0:5866:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006d8917cf from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787823418.064837:0:5866:0:(tgt_mount.c:187:server_put_mount()) put mount 000000006d8917cf from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787823418.064839:0:5866:0:(obd_mount.c:710:lustre_put_lsi()) put 000000006d8917cf 4 00010000:00080000:1.0:1787823418.064860:0:5866:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f2a36864@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.135@tcp at head 00010000:00010000:1.0:1787823418.067104:0:5866:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1787823418.067521:0:5866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787823418.067554:0:5866:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787823418.067566:0:5866:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5d1142b83248149b 00000100:00080000:1.0:1787823418.067577:0:5866:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787823418.067582:0:5866:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f2a36864 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:1.0:1787823418.067614:0:5866:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007cac5dea x1874668651809280/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787823418.067646:0:5866:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787823418.067873:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007cac5dea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874668651809280:0@lo:38: 00000100:00100000:2.0:1787823418.067933:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823418.068026:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651809280 00000100:00100000:1.0:1787823418.068031:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651809280 00000100:00100000:1.0:1787823418.068059:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787823418.068070:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048f3d261 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1874668651809280:12345-0@lo:38: 00000100:00100000:1.0:1787823418.068107:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048f3d261 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1874668651809280:12345-0@lo:38: Request processed in 37us (176us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787823418.068111:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787823418.068614:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787823418.068619:0:3304:0:(import.c:65:import_set_state_nolock()) 00000000f2a36864 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787823418.068623:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787823418.068625:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007cac5dea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874668651809280:0@lo:38: 00000100:00100000:2.0:1787823418.068909:0:5866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009c6a588a pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5866:1874668651809408:0@lo:502: 00000100:00100000:2.0:1787823418.068960:0:5866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823418.068980:0:5866:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ce043c75 going to sleep for 11 seconds 00000100:00100000:3.0:1787823418.069093:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651809408 00000100:00100000:3.0:1787823418.069096:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651809408 00000100:00100000:3.0:1787823418.069131:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787823418.069135:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e13abdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:5866:x1874668651809408:12345-0@lo:502: 00000100:00100000:3.0:1787823418.069543:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e13abdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:5866:x1874668651809408:12345-0@lo:502: Request processed in 407us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823418.069549:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787823418.069615:0:5866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009c6a588a pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5866:1874668651809408:0@lo:502: 00000040:00080000:2.0:1787823418.069636:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1787823418.069746:0:5819:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1787823418.069779:0:5819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787823418.069793:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: 00000000dce8dce2/0x5d1142b832481486 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248148d expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823418.069801:0:5819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: 00000000dce8dce2/0x5d1142b832481486 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248148d expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787823418.069843:0:5819:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787823418.069845:0:5819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787823418.069846:0:5819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787823418.069846:0:5819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787823418.069847:0:5819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787823418.069848:0:5819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787823418.069849:0:5819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787823418.069849:0:5819:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787823418.069850:0:5819:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787823418.069851:0:5819:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787823418.069852:0:5819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787823418.069853:0:5819:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787823418.069856:0:5819:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1787823418.069857:0:5819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787823418.069858:0:5819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787823418.069859:0:5819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787823418.069862:0:5819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787823418.069863:0:5819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787823418.069863:0:5819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787823418.069864:0:5819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787823418.069865:0:5819:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787823418.069865:0:5819:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787823418.069866:0:5819:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787823418.069866:0:5819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787823418.069867:0:5819:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787823418.069879:0:5819:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787823418.069886:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000030b5640d pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5819:1874668651809536:0@lo:253: 00000100:00100000:1.0:1787823418.069925:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823418.069943:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 000000001491db56 going to sleep for 11 seconds 00000100:00100000:2.0:1787823418.070083:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651809536 00000100:00100000:2.0:1787823418.070088:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651809536 00000100:00100000:2.0:1787823418.070112:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787823418.070116:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aaa6be88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:5819:x1874668651809536:12345-0@lo:253: 20000000:01000000:2.0:1787823418.070416:0:5831:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787823418.070428:0:5831:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787823418.124592:0:5831:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787823418.124615:0:5831:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787823418.128554:0:5854:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787823418.128566:0:5854:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787823418.128592:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008f929f8e/0x5d1142b8324814a2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823418.128612:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a9c562ea/0x5d1142b832481471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b83248146a expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823418.128620:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000008f929f8e/0x5d1142b8324814a2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823418.128865:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a9c562ea/0x5d1142b832481471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d1142b83248146a expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823418.128891:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a9c562ea/0x5d1142b832481471 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d1142b83248146a expref: 12 pid: 5833 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823418.128905:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005ef241dd pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1874668651809664:0@lo:104: 00000100:00100000:0.0:1787823418.128972:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823418.129036:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c4085e7e going to sleep for 11 seconds 00000100:00100000:2.0:1787823418.131179:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651809664 00000100:00100000:2.0:1787823418.131197:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651809664 00000100:00100000:2.0:1787823418.131263:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787823418.131272:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d831c2ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+3:5854:x1874668651809664:12345-0@lo:104: 00010000:00010000:2.0:1787823418.131292:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: 000000003ff6b1e7/0x5d1142b83248146a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b832481471 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823418.131994:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787823418.132002:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d831c2ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+3:5854:x1874668651809664:12345-0@lo:104: Request processed in 731us (3031us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823418.132011:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1787823418.132036:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787823418.132042:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: 000000003ff6b1e7/0x5d1142b83248146a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b832481471 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823418.132050:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003ff6b1e7 already unused, calling callback (00000000529dfb5c) 10000000:00010000:2.0:1787823418.132053:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: 000000003ff6b1e7/0x5d1142b83248146a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d1142b832481471 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823418.132061:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: 000000003ff6b1e7/0x5d1142b83248146a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d1142b832481471 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787823418.132068:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: 000000003ff6b1e7/0x5d1142b83248146a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d1142b832481471 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787823418.132073:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787823418.132106:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: 000000003ff6b1e7/0x5d1142b83248146a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832481471 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823418.132124:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787823418.132143:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: 000000003ff6b1e7/0x5d1142b83248146a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832481471 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823418.132149:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: 000000003ff6b1e7/0x5d1142b83248146a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832481471 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823418.132167:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823418.132168:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823418.132170:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787823418.132221:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009c6a588a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651809792:0@lo:103: 00000100:00100000:2.0:1787823418.132263:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823418.132338:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651809792 00000100:00100000:2.0:1787823418.132343:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651809792 00010000:00010000:2.0:1787823418.132374:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a9c562ea/0x5d1142b832481471 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b83248146a expref: 13 pid: 5833 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823418.132526:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005ef241dd pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1874668651809664:0@lo:104: 00010000:00010000:3.0:1787823418.132549:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000008f929f8e/0x5d1142b8324814a2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823418.134697:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787823418.134713:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aed49318 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:3306:x1874668651809792:12345-0@lo:103: 00010000:00010000:2.0:1787823418.134736:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787823418.134746:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a9c562ea/0x5d1142b832481471 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b83248146a expref: 13 pid: 5833 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823418.134777:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a9c562ea/0x5d1142b832481471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d1142b83248146a expref: 13 pid: 5833 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823418.134797:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a9c562ea/0x5d1142b832481471 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d1142b83248146a expref: 13 pid: 5833 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823418.134832:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000008f929f8e/0x5d1142b8324814a2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823418.134841:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008f929f8e/0x5d1142b8324814a2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787823418.134858:0:5823:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006293270s 00010000:00010000:2.0:1787823418.134864:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008f929f8e/0x5d1142b8324814a2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823418.134870:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008f929f8e/0x5d1142b8324814a2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823418.134876:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008f929f8e/0x5d1142b8324814a2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823418.134882:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008f929f8e/0x5d1142b8324814a2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823418.134888:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008f929f8e already unused, calling callback (00000000b5a64369) 00010000:00010000:2.0:1787823418.134892:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008f929f8e/0x5d1142b8324814a2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823418.134898:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008f929f8e/0x5d1142b8324814a2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823418.134913:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008f929f8e/0x5d1142b8324814a2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823418.134924:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787823418.134997:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aed49318 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:3306:x1874668651809792:12345-0@lo:103: Request processed in 289us (2734us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823418.135004:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787823418.135835:0:5854:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000008f929f8e/0x5d1142b8324814a2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823418.135847:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008f929f8e/0x5d1142b8324814a2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823418.135867:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008f929f8e/0x5d1142b8324814a2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823418.138021:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009c6a588a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651809792:0@lo:103: 00000100:00100000:1.0:1787823418.140312:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aaa6be88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+11:5819:x1874668651809536:12345-0@lo:253: Request processed in 70187us (70379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823418.140329:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787823418.141151:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000030b5640d pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5819:1874668651809536:0@lo:253: 10000000:01000000:3.0:1787823418.141169:0:5819:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787823418.141172:0:5819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787823418.141174:0:5819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787823418.141175:0:5819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787823418.141176:0:5819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787823418.141178:0:5819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787823418.141179:0:5819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787823418.141180:0:5819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787823418.141181:0:5819:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787823418.141183:0:5819:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787823418.141184:0:5819:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787823418.141185:0:5819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787823418.141187:0:5819:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787823418.141202:0:5819:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787823418.155193:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1787823418.157242:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787823418.160068:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1787823418.161199:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787823418.161866:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1787823418.162072:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1787823418.163275:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1787823418.163909:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1787823418.164120:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1787823418.164299:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1787823418.164971:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1787823418.165206:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1787823418.212397:0:5819:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1787823418.252062:0:5819:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1787823418.252468:0:5872:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:2.0:1787823418.253279:0:5871:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1787823418.253284:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1787823418.265205:0:5819:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787823418.265512:0:5819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787823418.266234:0:5819:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787823418.266246:0:5819:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787823418.269033:0:5819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787823418.271814:0:5819:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787823418.272658:0:5819:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787823418.272786:0:5819:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1787823418.273105:0:5819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1787823418.273314:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1787823418.285627:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1787823418.287029:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1787823418.287142:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1787823418.287254:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1787823418.289169:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1787823418.289926:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1787823418.290079:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1787823418.290210:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1787823418.290339:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1787823418.290812:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1787823418.290988:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1787823418.291125:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1787823418.291286:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1787823418.291439:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1787823418.291577:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1787823418.291725:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1787823418.292046:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1787823418.292194:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1787823418.292341:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1787823418.292488:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1787823418.292640:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1787823418.292797:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1787823418.292962:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1787823418.293105:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1787823418.293242:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1787823418.293377:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1787823418.293504:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1787823418.293647:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1787823418.293853:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1787823418.293987:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1787823418.294135:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1787823418.294267:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1787823418.296148:0:5819:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1787823418.333553:0:5872:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1787823418.398301:0:5819:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787823418.398351:0:5819:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa52501ccb988 00100000:10000000:3.0:1787823418.398359:0:5819:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787823418.399731:0:5819:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787823418.399749:0:5819:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.135@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787823418.399787:0:5819:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1787823418.399805:0:5819:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1787823418.456119:0:5872:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787823418.456207:0:5872:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787823418.456212:0:5872:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1787823418.602150:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823419.626300:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823420.657846:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823421.674019:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823422.698131:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787823422.954333:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787823422.954341:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e79034dc800 from 3 10000000:01000000:0.0:1787823422.954346:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787823422.954399:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: 00000000a988888e/0x5d1142b8324814a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823422.954414:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: 00000000a988888e/0x5d1142b8324814a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823422.954425:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: 00000000a988888e/0x5d1142b8324814a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823422.954450:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005ef241dd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651809920:0@lo:101: 00000100:00100000:0.0:1787823422.954519:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823422.954577:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set 000000009f1aa72f going to sleep for 11 seconds 00000100:00100000:2.0:1787823422.954706:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651809920 00000100:00100000:2.0:1787823422.954714:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651809920 00000100:00100000:2.0:1787823422.954794:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787823422.954803:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081a0e3e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+11:5835:x1874668651809920:12345-0@lo:101: 00010000:00010000:2.0:1787823422.954815:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823422.954828:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002b0cabc3/0x5d1142b8324814b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b8324814a9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823422.954852:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002b0cabc3/0x5d1142b8324814b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b8324814a9 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823422.954861:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002b0cabc3/0x5d1142b8324814b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b8324814a9 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823422.954870:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002b0cabc3, rc 0) 00000100:00100000:2.0:1787823422.954908:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081a0e3e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:5835:x1874668651809920:12345-0@lo:101: Request processed in 107us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823422.954915:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787823422.955079:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005ef241dd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651809920:0@lo:101: 00010000:00010000:0.0:1787823422.955093:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: 00000000a988888e/0x5d1142b8324814a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324814b0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823422.955112:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: 00000000a988888e/0x5d1142b8324814a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b8324814b0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823422.955171:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005ef241dd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651810048:0@lo:256: 00000100:00100000:0.0:1787823422.955203:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823422.955232:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set 000000009f1aa72f going to sleep for 11 seconds 00000100:00100000:2.0:1787823422.955452:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651810048 00000100:00100000:2.0:1787823422.955463:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651810048 00000100:00100000:2.0:1787823422.955497:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787823422.955503:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bef44238 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:5835:x1874668651810048:12345-0@lo:256: 20000000:01000000:2.0:1787823422.955519:0:5831:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787823422.955535:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787823422.955538:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1787823422.955636:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bef44238 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:5835:x1874668651810048:12345-0@lo:256: Request processed in 133us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823422.955643:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787823422.956032:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005ef241dd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651810048:0@lo:256: 10000000:01000000:0.0:1787823422.956092:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787823422.956099:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: 00000000a988888e/0x5d1142b8324814a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324814b0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823422.956108:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: 00000000a988888e/0x5d1142b8324814a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324814b0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787823423.466061:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787823423.466072:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787823423.466075:0:8:0:(import.c:65:import_set_state_nolock()) 00000000f2a36864 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787823423.466088:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f2a36864 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:0.0:1787823423.466112:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007d291008 x1874668651810304/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787823423.466152:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007d291008 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874668651810304:0@lo:38: 00000100:00100000:0.0:1787823423.466233:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823423.466361:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787823423.466369:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005ef241dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3308:1874668651810176:0@lo:400: 00000100:00100000:0.0:1787823423.466400:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823423.466476:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651810176 00000100:00100000:0.0:1787823423.466484:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651810176 00000100:00100000:0.0:1787823423.466527:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787823423.466535:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000786b2110 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:3308:x1874668651810176:12345-0@lo:400: 00000100:00100000:0.0:1787823423.466583:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000786b2110 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:3308:x1874668651810176:12345-0@lo:400: Request processed in 49us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823423.466590:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787823423.466634:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005ef241dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3308:1874668651810176:0@lo:400: 00000100:00100000:0.0:1787823423.466674:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651810304 00000100:00100000:0.0:1787823423.466678:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651810304 00000100:00100000:0.0:1787823423.466699:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787823423.466703:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009cd5fadd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1874668651810304:12345-0@lo:38: 00010000:00080000:0.0:1787823423.466725:0:5840:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:0.0:1787823423.466791:0:5840:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5d1142b8324814b7 00000004:00100000:0.0:1787823423.466840:0:5840:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787823423.466957:0:5840:0:(import.c:65:import_set_state_nolock()) 00000000a9712c02 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787823423.466998:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009cd5fadd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874668651810304:12345-0@lo:38: Request processed in 293us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823423.467005:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787823423.467036:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007d291008 x1874668651810304/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787823433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787823423.467051:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787823423.467059:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787823423.467063:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787823423.467066:0:3304:0:(import.c:65:import_set_state_nolock()) 00000000f2a36864 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787823423.467072:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007d291008 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874668651810304:0@lo:38: 00000001:02000400:1.0:1787823423.722756:0:6115:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg235-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787823423.724699:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823424.750241:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823425.771258:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823426.794053:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823427.818999:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823428.590145:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000749e0c67 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3308:1874668651810432:0@lo:400: 00000100:00100000:1.0:1787823428.590222:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823428.590735:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651810432 00000100:00100000:1.0:1787823428.590744:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651810432 00000100:00100000:1.0:1787823428.590822:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787823428.590832:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004a52053a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:3308:x1874668651810432:12345-0@lo:400: 00000100:00100000:1.0:1787823428.590901:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004a52053a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:3308:x1874668651810432:12345-0@lo:400: Request processed in 72us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823428.590909:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787823428.590971:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000749e0c67 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3308:1874668651810432:0@lo:400: 00000100:00100000:1.0:1787823428.591036:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000749e0c67 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874668651810560:0@lo:400: 00000100:00100000:1.0:1787823428.591082:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823428.591118:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651810560 00000100:00100000:1.0:1787823428.591122:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651810560 00000100:00100000:1.0:1787823428.591150:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787823428.591157:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e27561a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874668651810560:12345-0@lo:400: 00000100:00100000:1.0:1787823428.591189:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e27561a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874668651810560:12345-0@lo:400: Request processed in 33us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823428.591195:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787823428.591219:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000749e0c67 x1874668651810560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787823444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787823428.591230:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000749e0c67 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874668651810560:0@lo:400: 00010000:00010000:1.0:1787823428.844485:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787823429.195477:0:6317:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc3b7d0ac0 20000000:00000080:2.0:1787823429.195497:0:6317:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e793a222800 uarg=0000000000000000 20000000:01000000:2.0:1787823429.195656:0:6317:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787823429.195663:0:6317:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787823429.195668:0:6317:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787823429.195889:0:6317:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1787823429.195901:0:6317:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1787823429.201733:0:6317:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787823429.202148:0:6317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787823429.202210:0:6317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1787823429.202277:0:6317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1787823429.202368:0:6317:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787823429.202388:0:6317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000af23f5ab/0x5d1142b8324814be lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823429.202421:0:6317:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000fb05fada/0x5d1142b83248147f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832481478 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823429.202430:0:6317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000af23f5ab/0x5d1142b8324814be lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823429.202471:0:6317:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000fb05fada/0x5d1142b83248147f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d1142b832481478 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823429.202488:0:6317:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000fb05fada/0x5d1142b83248147f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d1142b832481478 expref: 11 pid: 5831 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823429.202510:0:6317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fe1f47ef pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6317:1874668651810688:0@lo:104: 00000100:00100000:3.0:1787823429.202907:0:6317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823429.203014:0:6317:0:(client.c:2715:ptlrpc_set_wait()) set 000000003adda4a9 going to sleep for 11 seconds 00000100:00100000:2.0:1787823429.203097:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651810688 00000100:00100000:2.0:1787823429.203105:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651810688 00000100:00100000:2.0:1787823429.203199:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787823429.203208:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9a3e263 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+3:6317:x1874668651810688:12345-0@lo:104: 00010000:00010000:2.0:1787823429.203220:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: 000000002c754e28/0x5d1142b832481478 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b83248147f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823429.203343:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787823429.203349:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9a3e263 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+3:6317:x1874668651810688:12345-0@lo:104: Request processed in 144us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823429.203357:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1787823429.203493:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787823429.203499:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: 000000002c754e28/0x5d1142b832481478 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b83248147f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823429.203507:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002c754e28 already unused, calling callback (00000000529dfb5c) 10000000:00010000:1.0:1787823429.203509:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: 000000002c754e28/0x5d1142b832481478 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d1142b83248147f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823429.203525:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: 000000002c754e28/0x5d1142b832481478 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d1142b83248147f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787823429.203532:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: 000000002c754e28/0x5d1142b832481478 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d1142b83248147f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787823429.203542:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787823429.203582:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: 000000002c754e28/0x5d1142b832481478 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b83248147f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823429.203589:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787823429.203605:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: 000000002c754e28/0x5d1142b832481478 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b83248147f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823429.203610:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: 000000002c754e28/0x5d1142b832481478 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b83248147f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823429.203626:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823429.203627:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823429.203629:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823429.203639:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007fcf82b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651810816:0@lo:103: 00000100:00100000:1.0:1787823429.203671:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823429.203883:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651810816 00000100:00100000:0.0:1787823429.203888:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651810816 00010000:00010000:0.0:1787823429.203905:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000fb05fada/0x5d1142b83248147f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b832481478 expref: 12 pid: 5831 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823429.203934:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787823429.203940:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000949d7160 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:3306:x1874668651810816:12345-0@lo:103: 00010000:00010000:0.0:1787823429.203950:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787823429.203955:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000fb05fada/0x5d1142b83248147f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b832481478 expref: 12 pid: 5831 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823429.203965:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000fb05fada/0x5d1142b83248147f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d1142b832481478 expref: 12 pid: 5831 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823429.203983:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000af23f5ab/0x5d1142b8324814be lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823429.203991:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000af23f5ab/0x5d1142b8324814be lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823429.204004:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000af23f5ab/0x5d1142b8324814be lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823429.204009:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000af23f5ab/0x5d1142b8324814be lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823429.204015:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000af23f5ab/0x5d1142b8324814be lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823429.204021:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000af23f5ab/0x5d1142b8324814be lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823429.204037:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000af23f5ab already unused, calling callback (00000000b5a64369) 00010000:00010000:0.0:1787823429.204040:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000af23f5ab/0x5d1142b8324814be lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823429.204047:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000af23f5ab/0x5d1142b8324814be lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823429.204056:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000af23f5ab/0x5d1142b8324814be lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823429.204065:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787823429.204101:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000949d7160 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:3306:x1874668651810816:12345-0@lo:103: Request processed in 160us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823429.204108:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787823429.204142:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007fcf82b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651810816:0@lo:103: 00010000:00010000:3.0:1787823429.204556:0:6317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fb05fada/0x5d1142b83248147f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d1142b832481478 expref: 11 pid: 5831 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823429.204568:0:6317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fe1f47ef pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6317:1874668651810688:0@lo:104: 00010000:00010000:3.0:1787823429.204583:0:6317:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000af23f5ab/0x5d1142b8324814be lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823429.204590:0:6317:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000af23f5ab/0x5d1142b8324814be lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823429.204595:0:6317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000af23f5ab/0x5d1142b8324814be lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823429.204599:0:6317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000af23f5ab/0x5d1142b8324814be lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823429.874108:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787823429.935031:0:5835:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787823429.935040:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e79034dc800 from 1 10000000:01000000:0.0:1787823429.935044:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787823429.935086:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: 00000000fb05fada/0x5d1142b8324814c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823429.935098:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: 00000000fb05fada/0x5d1142b8324814c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823429.935109:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: 00000000fb05fada/0x5d1142b8324814c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823429.935132:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d97e54e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651810944:0@lo:101: 00000100:00100000:0.0:1787823429.935214:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823429.935280:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c1e56180 going to sleep for 11 seconds 00000100:00100000:2.0:1787823429.935282:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651810944 00000100:00100000:2.0:1787823429.935288:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651810944 00000100:00100000:2.0:1787823429.935339:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787823429.935347:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000876f5293 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+11:5835:x1874668651810944:12345-0@lo:101: 00010000:00010000:2.0:1787823429.935360:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823429.935372:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002c754e28/0x5d1142b8324814cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b8324814c5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823429.935392:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002c754e28/0x5d1142b8324814cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b8324814c5 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823429.935400:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002c754e28/0x5d1142b8324814cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b8324814c5 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823429.935408:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002c754e28, rc 0) 00000100:00100000:2.0:1787823429.935441:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000876f5293 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:5835:x1874668651810944:12345-0@lo:101: Request processed in 96us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823429.935447:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787823429.936073:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d97e54e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651810944:0@lo:101: 00010000:00010000:0.0:1787823429.936089:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: 00000000fb05fada/0x5d1142b8324814c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324814cc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823429.936097:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: 00000000fb05fada/0x5d1142b8324814c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b8324814cc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823429.936149:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d97e54e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651811072:0@lo:501: 00000100:00100000:0.0:1787823429.936178:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823429.936209:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c1e56180 going to sleep for 11 seconds 00000100:00100000:2.0:1787823429.937074:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651811072 00000100:00100000:2.0:1787823429.937082:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651811072 00000100:00100000:2.0:1787823429.937120:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787823429.937127:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0806702 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:5835:x1874668651811072:12345-0@lo:501: 00000100:00100000:2.0:1787823429.937408:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0806702 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:5835:x1874668651811072:12345-0@lo:501: Request processed in 281us (1229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823429.937415:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787823429.937587:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d97e54e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651811072:0@lo:501: 00000100:00100000:0.0:1787823429.937636:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d97e54e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651811200:0@lo:503: 00000100:00100000:0.0:1787823429.937692:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823429.937721:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c1e56180 going to sleep for 11 seconds 00000100:00100000:2.0:1787823429.939143:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651811200 00000100:00100000:2.0:1787823429.939156:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651811200 00000100:00100000:2.0:1787823429.939230:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787823429.939239:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000839e5bba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:5835:x1874668651811200:12345-0@lo:503: 00000100:00100000:2.0:1787823429.939478:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000839e5bba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:5835:x1874668651811200:12345-0@lo:503: Request processed in 240us (1786us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823429.939493:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787823429.939547:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d97e54e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651811200:0@lo:503: 00000100:00100000:3.0:1787823429.947395:0:6336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fe1f47ef pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6336:1874668651811328:0@lo:502: 00000100:00100000:3.0:1787823429.947484:0:6336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823429.947583:0:6336:0:(client.c:2715:ptlrpc_set_wait()) set 00000000830135d4 going to sleep for 11 seconds 00000100:00100000:1.0:1787823429.949334:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651811328 00000100:00100000:1.0:1787823429.949352:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651811328 00000100:00100000:1.0:1787823429.949411:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787823429.949419:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9416223 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:6336:x1874668651811328:12345-0@lo:502: 00000100:00100000:1.0:1787823429.949697:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9416223 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:6336:x1874668651811328:12345-0@lo:502: Request processed in 278us (2213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823429.949705:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787823429.949911:0:6336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fe1f47ef pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6336:1874668651811328:0@lo:502: 00000020:01000000:3.0:1787823429.949953:0:6336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787823429.950137:0:6336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787823429.950140:0:6336:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787823429.950152:0:6336:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e79034dc800 00000020:00000080:3.0:1787823429.950155:0:6336:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787823429.950214:0:6336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ad52d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6336:1874668651811456:0@lo:502: 00000100:00100000:3.0:1787823429.950657:0:6336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823429.950701:0:6336:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7903611840 going to sleep for 11 seconds 00000100:00100000:2.0:1787823429.950788:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651811456 00000100:00100000:2.0:1787823429.950795:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651811456 00000100:00100000:2.0:1787823429.950841:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787823429.950849:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:6336:x1874668651811456:12345-0@lo:502: 00000100:00100000:2.0:1787823429.951018:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:6336:x1874668651811456:12345-0@lo:502: Request processed in 169us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823429.951026:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787823429.951035:0:6336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ad52d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6336:1874668651811456:0@lo:502: 00000020:01000000:3.0:1787823429.951192:0:6336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787823429.951197:0:6336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787823429.951199:0:6336:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787823429.951205:0:6336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1787823429.951468:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787823429.951489:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787823429.951499:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7900031c00/0x5d1142b8324814c5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324814cc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823429.951518:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e7900031c00/0x5d1142b8324814c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324814cc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823430.889987:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823431.916926:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823432.938182:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823433.706068:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790ae830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874668651811712:0@lo:400: 00000100:00100000:2.0:1787823433.706434:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790ae81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651811584:0@lo:400: 00000100:00100000:2.0:1787823433.706474:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823433.707244:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823433.707375:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651811712 00000100:00100000:3.0:1787823433.707383:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651811712 00000100:00100000:3.0:1787823433.707439:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787823433.707450:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ad50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874668651811712:12345-0@lo:400: 00000100:00100000:3.0:1787823433.707511:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ad50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874668651811712:12345-0@lo:400: Request processed in 64us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823433.707519:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787823433.707563:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e790ae830c0 x1874668651811712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787823449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823433.707578:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790ae830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874668651811712:0@lo:400: 00000100:00100000:2.0:1787823433.707873:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651811584 00000100:00100000:2.0:1787823433.707878:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651811584 00000100:00100000:2.0:1787823433.707912:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787823433.707921:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:3307:x1874668651811584:12345-0@lo:400: 00000100:00100000:2.0:1787823433.707964:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:3307:x1874668651811584:12345-0@lo:400: Request processed in 45us (1490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823433.707970:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787823433.708012:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790ae81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651811584:0@lo:400: 00010000:00010000:0.0:1787823433.961936:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823434.986148:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787823435.984414:0:6682:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787823435.984420:0:6682:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1787823435.984568:0:6682:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e7909bc2800 00000020:01000004:3.0:1787823435.984584:0:6682:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787823435.984596:0:6682:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787823435.984610:0:6682:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8e7906ef19d0) 00000020:00000080:3.0:1787823435.984627:0:6682:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787823436.003271:0:6682:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787823436.003604:0:6682:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00010000:00010000:0.0:1787823436.009915:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1787823436.031202:0:6682:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787823436.037616:0:6682:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787823436.037650:0:6682:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787823436.037700:0:6682:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787823436.037734:0:6682:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787823436.038539:0:6682:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787823436.038559:0:6682:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787823436.038571:0:6682:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5d1142b8324814da 00000020:01000004:3.0:1787823436.038579:0:6682:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1787823436.038895:0:6682:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.135@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787823436.038907:0:6682:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.135@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787823436.039058:0:6682:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787823436.039064:0:6682:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787823436.039086:0:6682:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8e7903708000) 00000020:00000080:3.0:1787823436.039098:0:6682:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1787823436.041742:0:6682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787823436.043676:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787823436.043684:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787823436.050081:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787823436.053457:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1787823436.054182:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1787823436.054199:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787823436.056230:0:6682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787823436.056535:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787823436.056547:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787823436.057425:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787823436.057435:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787823436.086505:0:6682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787823436.086745:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787823436.086752:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787823436.090112:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787823436.090201:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787823436.095111:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787823436.095134:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787823436.100300:0:6682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787823436.100563:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787823436.100569:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787823436.102456:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787823436.102478:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1787823436.192219:0:6682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787823436.192506:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1787823436.192514:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787823436.194421:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787823436.194434:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787823436.195092:0:6682:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787823436.195119:0:6682:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1787823436.195126:0:6682:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.135@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787823436.231658:0:6682:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.135@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787823436.231695:0:6682:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.135@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1787823436.231698:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787823436.231699:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787823436.231700:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787823436.231701:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787823436.231702:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787823436.231702:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787823436.231704:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787823436.231705:0:6682:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787823436.231705:0:6682:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787823436.231707:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787823436.231707:0:6682:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787823436.231710:0:6682:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1787823436.231711:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787823436.231712:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787823436.231713:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787823436.231713:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787823436.231714:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787823436.231715:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787823436.231715:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787823436.231716:0:6682:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787823436.231716:0:6682:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787823436.231717:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787823436.231718:0:6682:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787823436.231738:0:6682:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787823436.231754:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ac87840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651811840:0@lo:253: 00000100:00100000:2.0:1787823436.235583:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823436.235649:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908c23780 going to sleep for 11 seconds 00000100:00100000:3.0:1787823436.235867:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651811840 00000100:00100000:3.0:1787823436.235877:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651811840 00000100:00100000:3.0:1787823436.235940:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787823436.235949:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:6682:x1874668651811840:12345-0@lo:253: 20000000:01000000:3.0:1787823436.236105:0:5832:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787823436.236109:0:5832:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1787823436.236115:0:5832:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1787823436.236119:0:5832:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1787823436.238523:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787823436.239297:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1787823436.239317:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1787823436.241610:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1787823436.241659:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1787823436.241704:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1787823436.241814:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1787823436.242353:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1787823436.242683:0:5832:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.135@tcp 20000000:01000000:3.0:1787823436.242686:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.135@tcp (null) (null) (null) 00000040:00080000:3.0:1787823436.242746:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1787823436.242755:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787823436.242836:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1787823436.242845:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.135@tcp (null) (null) 00000040:00080000:3.0:1787823436.242879:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1787823436.242889:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787823436.242934:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1787823436.243014:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1787823436.244285:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1787823436.244310:0:5832:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.135@tcp 20000000:01000000:3.0:1787823436.244311:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.135@tcp (null) (null) (null) 00000040:00080000:3.0:1787823436.244504:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1787823436.244513:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787823436.244549:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1787823436.244555:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.135@tcp (null) (null) 00000040:00080000:3.0:1787823436.244602:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1787823436.244612:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787823436.244644:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1787823436.244680:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1787823436.244697:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1787823436.244700:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1787823436.244708:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787823436.244709:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787823436.244711:0:5832:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787823436.244738:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787823436.244746:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787823436.244811:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787823436.244814:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787823436.247686:0:6698:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1787823436.249137:0:6698:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1787823436.249320:0:6698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1787823436.250057:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1787823436.250101:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1787823436.250178:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1787823436.250201:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787823436.250203:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787823436.250945:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1787823436.251296:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1787823436.251355:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1787823436.251471:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1787823436.251484:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787823436.251487:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787823436.253313:0:6700:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1787823436.253490:0:6700:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1787823436.253543:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1787823436.255510:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1787823436.255572:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1787823436.255610:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 10000000:01000000:3.0:1787823436.255635:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787823436.255661:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e7920eebc00/0x5d1142b8324814e8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823436.255682:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e79013a3000/0x5d1142b832481401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b8324813fa expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823436.255693:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7900031000/0x5d1142b83248141d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832481416 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823436.255699:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7901676c00/0x5d1142b83248148d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832481486 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823436.255705:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e7920eebc00/0x5d1142b8324814e8 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823436.255750:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7901676c00/0x5d1142b83248148d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d1142b832481486 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823436.256126:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7901676c00/0x5d1142b83248148d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d1142b832481486 expref: 12 pid: 5833 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823436.256141:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ad53480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1874668651811968:0@lo:104: 00000100:00100000:3.0:1787823436.256305:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787823436.256477:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7900031000/0x5d1142b83248141d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d1142b832481416 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823436.256487:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7900031000/0x5d1142b83248141d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d1142b832481416 expref: 12 pid: 5832 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823436.256494:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ad52940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1874668651812096:0@lo:104: 00000100:00100000:3.0:1787823436.256516:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787823436.256657:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e79013a3000/0x5d1142b832481401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d1142b8324813fa expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823436.256667:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e79013a3000/0x5d1142b832481401 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d1142b8324813fa expref: 12 pid: 5831 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823436.256677:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ad521c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1874668651812224:0@lo:104: 00000100:00100000:3.0:1787823436.256716:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823436.256734:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651811968 00000100:00100000:2.0:1787823436.256741:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651811968 00000100:00100000:0.0:1787823436.256834:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651812096 00000100:00100000:0.0:1787823436.256838:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651812096 00000100:00100000:0.0:1787823436.256865:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787823436.256876:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ad50780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+4:5832:x1874668651811968:12345-0@lo:104: 00010000:00010000:0.0:1787823436.256895:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff8e7900031800/0x5d1142b832481486 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b83248148d expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823436.256981:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787823436.256989:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ad50780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+4:5832:x1874668651811968:12345-0@lo:104: Request processed in 116us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823436.256996:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787823436.257020:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787823436.257027:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ad512c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+3:5832:x1874668651812096:12345-0@lo:104: 00010000:00010000:0.0:1787823436.257035:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff8e7920eea400/0x5d1142b832481416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b83248141d expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823436.257070:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787823436.257075:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ad512c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+3:5832:x1874668651812096:12345-0@lo:104: Request processed in 50us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823436.257081:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1787823436.257098:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787823436.257104:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e7900031800/0x5d1142b832481486 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b83248148d expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823436.257129:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7900031800 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:0.0:1787823436.257134:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e7900031800/0x5d1142b832481486 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d1142b83248148d expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823436.257152:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e7900031800/0x5d1142b832481486 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d1142b83248148d expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787823436.257160:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e7900031800/0x5d1142b832481486 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d1142b83248148d expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787823436.257165:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787823436.257228:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e7900031800/0x5d1142b832481486 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b83248148d expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823436.257235:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787823436.257251:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e7900031800/0x5d1142b832481486 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b83248148d expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823436.257258:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e7900031800/0x5d1142b832481486 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b83248148d expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823436.257273:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787823436.257277:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e7920eea400/0x5d1142b832481416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b83248141d expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823436.257283:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eea400 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:0.0:1787823436.257285:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e7920eea400/0x5d1142b832481416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d1142b83248141d expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823436.257303:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e7920eea400/0x5d1142b832481416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d1142b83248141d expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787823436.257309:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e7920eea400/0x5d1142b832481416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d1142b83248141d expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787823436.257313:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787823436.257329:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e7920eea400/0x5d1142b832481416 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b83248141d expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823436.257446:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823436.257470:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651812352:0@lo:103: 00000100:00100000:1.0:1787823436.257502:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823436.257541:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651812352 00000100:00100000:1.0:1787823436.257544:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651812352 00010000:00010000:1.0:1787823436.257561:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7901676c00/0x5d1142b83248148d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b832481486 expref: 13 pid: 5833 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823436.257580:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787823436.257585:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790ae81e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:3305:x1874668651812352:12345-0@lo:103: 00010000:00010000:1.0:1787823436.257595:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823436.257599:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7901676c00/0x5d1142b83248148d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b832481486 expref: 13 pid: 5833 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823436.257611:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7901676c00/0x5d1142b83248148d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d1142b832481486 expref: 13 pid: 5833 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823436.257638:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823436.257661:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790ae81e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:3305:x1874668651812352:12345-0@lo:103: Request processed in 76us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823436.257667:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787823436.257697:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651812352:0@lo:103: 00010000:00010000:0.0:1787823436.258270:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787823436.258292:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e7920eea400/0x5d1142b832481416 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b83248141d expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823436.258299:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e7920eea400/0x5d1142b832481416 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b83248141d expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823436.258314:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823436.258315:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823436.258317:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823436.258426:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651812480:0@lo:103: 00000100:00100000:0.0:1787823436.258479:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823436.258620:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7909a44d80 going to sleep for 11 seconds 00010000:00010000:3.0:1787823436.258641:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7901676c00/0x5d1142b83248148d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d1142b832481486 expref: 12 pid: 5833 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823436.258653:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ad53480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1874668651811968:0@lo:104: 00000100:00100000:3.0:1787823436.258663:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ad52940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1874668651812096:0@lo:104: 00000100:00100000:0.0:1787823436.258710:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651812224 00000100:00100000:0.0:1787823436.258715:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651812224 00000100:00100000:0.0:1787823436.258740:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787823436.258747:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ad50f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+3:5832:x1874668651812224:12345-0@lo:104: 00010000:00010000:0.0:1787823436.258783:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff8e7901676000/0x5d1142b8324813fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b832481401 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823436.258847:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787823436.258854:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ad50f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+3:5832:x1874668651812224:12345-0@lo:104: Request processed in 107us (2138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823436.258860:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787823436.258960:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ad521c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1874668651812224:0@lo:104: 00010000:00010000:3.0:1787823436.259007:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e7920eebc00/0x5d1142b8324814e8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823436.259481:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651812480 00000100:00100000:1.0:1787823436.259487:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651812480 00010000:00010000:1.0:1787823436.259511:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7900031000/0x5d1142b83248141d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b832481416 expref: 12 pid: 5832 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823436.259571:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787823436.259578:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790aef0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:3306:x1874668651812480:12345-0@lo:103: 00010000:00010000:1.0:1787823436.259589:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823436.259593:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7900031000/0x5d1142b83248141d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b832481416 expref: 12 pid: 5832 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823436.259603:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7900031000/0x5d1142b83248141d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d1142b832481416 expref: 12 pid: 5832 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823436.259620:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7900031000/0x5d1142b83248141d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d1142b832481416 expref: 12 pid: 5832 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823436.259631:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823436.259679:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790aef0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+11:3306:x1874668651812480:12345-0@lo:103: Request processed in 102us (1200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823436.259686:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787823436.259740:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651812480:0@lo:103: 00010000:00010000:1.0:1787823436.260028:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787823436.260034:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e7901676000/0x5d1142b8324813fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b832481401 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823436.260052:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7901676000 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:1.0:1787823436.260056:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e7901676000/0x5d1142b8324813fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d1142b832481401 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823436.260063:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e7901676000/0x5d1142b8324813fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d1142b832481401 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787823436.260069:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e7901676000/0x5d1142b8324813fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d1142b832481401 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787823436.260074:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787823436.260213:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e7901676000/0x5d1142b8324813fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832481401 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823436.260222:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787823436.260270:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790ae80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651812608:0@lo:103: 00000100:00100000:3.0:1787823436.260312:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823436.260385:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651812608 00000100:00100000:0.0:1787823436.260391:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651812608 00010000:00010000:0.0:1787823436.260410:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e79013a3000/0x5d1142b832481401 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b8324813fa expref: 11 pid: 5831 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823436.260429:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787823436.260436:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ad521c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+11:3307:x1874668651812608:12345-0@lo:103: 00010000:00010000:0.0:1787823436.260445:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787823436.260449:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e79013a3000/0x5d1142b832481401 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b8324813fa expref: 11 pid: 5831 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823436.260458:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e79013a3000/0x5d1142b832481401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d1142b8324813fa expref: 11 pid: 5831 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823436.260472:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e79013a3000/0x5d1142b832481401 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d1142b8324813fa expref: 11 pid: 5831 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823436.260488:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e7920eebc00/0x5d1142b8324814e8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823436.260496:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7920eebc00/0x5d1142b8324814e8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823436.260509:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7920eebc00/0x5d1142b8324814e8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823436.260527:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7920eebc00/0x5d1142b8324814e8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823436.260534:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e7920eebc00/0x5d1142b8324814e8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823436.260540:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e7920eebc00/0x5d1142b8324814e8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823436.260545:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eebc00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:0.0:1787823436.260549:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e7920eebc00/0x5d1142b8324814e8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823436.260557:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e7920eebc00/0x5d1142b8324814e8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823436.260573:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e7920eebc00/0x5d1142b8324814e8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823436.260581:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787823436.260715:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e7901676000/0x5d1142b8324813fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832481401 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823436.260723:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e7901676000/0x5d1142b8324813fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832481401 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823436.260740:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823436.260742:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823436.260744:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823436.260931:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ad521c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+10:3307:x1874668651812608:12345-0@lo:103: Request processed in 495us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823436.260939:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787823436.261114:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790ae80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651812608:0@lo:103: 00010000:00010000:3.0:1787823436.261138:0:5832:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e7920eebc00/0x5d1142b8324814e8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823436.261473:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e7920eebc00/0x5d1142b8324814e8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823436.261480:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7920eebc00/0x5d1142b8324814e8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787823436.261494:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787823436.312522:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+9:6682:x1874668651811840:12345-0@lo:253: Request processed in 76561us (76932us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823436.312541:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787823436.312635:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ac87840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651811840:0@lo:253: 10000000:01000000:2.0:1787823436.312667:0:6682:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787823436.312670:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787823436.312672:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787823436.312673:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787823436.312675:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1787823436.312676:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787823436.312677:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787823436.312679:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787823436.312680:0:6682:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787823436.312682:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787823436.312683:0:6682:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787823436.312704:0:6682:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e7909bc2800 from lustre-OST0000 10000000:01000000:2.0:1787823436.312746:0:6682:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787823436.312750:0:6682:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787823436.312776:0:6682:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e7906ef0000 local copy 10000000:01000000:2.0:1787823436.312781:0:6682:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787823436.312818:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e79013a3c00/0x5d1142b8324814ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823436.312828:0:6682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.135@tcp lock: ffff8e79013a3c00/0x5d1142b8324814ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823436.312836:0:6682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e79013a3c00/0x5d1142b8324814ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823436.312853:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ac87840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651812736:0@lo:101: 00000100:00100000:2.0:1787823436.312890:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823436.313210:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908c23780 going to sleep for 11 seconds 00000100:00100000:3.0:1787823436.313312:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651812736 00000100:00100000:3.0:1787823436.313320:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651812736 00000100:00100000:3.0:1787823436.313462:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787823436.313473:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+9:6682:x1874668651812736:12345-0@lo:101: 00010000:00010000:3.0:1787823436.313486:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823436.313500:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7920eebc00/0x5d1142b8324814f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b8324814ef expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823436.313527:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7920eebc00/0x5d1142b8324814f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b8324814ef expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823436.313552:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7920eebc00/0x5d1142b8324814f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b8324814ef expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823436.313563:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7920eebc00, rc 0) 00000100:00100000:3.0:1787823436.313615:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+10:6682:x1874668651812736:12345-0@lo:101: Request processed in 144us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823436.313621:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787823436.313692:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ac87840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651812736:0@lo:101: 00010000:00010000:1.0:1787823436.313708:0:6682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e79013a3c00/0x5d1142b8324814ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5d1142b8324814f6 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823436.313717:0:6682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e79013a3c00/0x5d1142b8324814ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5d1142b8324814f6 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823436.313846:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790ae80b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651812864:0@lo:501: 00000100:00100000:1.0:1787823436.313879:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823436.314260:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908cbc540 going to sleep for 11 seconds 00000100:00100000:2.0:1787823436.314300:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651812864 00000100:00100000:2.0:1787823436.314306:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651812864 00000100:00100000:2.0:1787823436.314342:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787823436.314351:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+10:6682:x1874668651812864:12345-0@lo:501: 00000100:00100000:2.0:1787823436.314592:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+10:6682:x1874668651812864:12345-0@lo:501: Request processed in 242us (711us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787823436.314621:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787823436.314698:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790ae80b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651812864:0@lo:501: 10000000:01000000:1.0:1787823436.314713:0:6682:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.135@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787823436.314743:0:6682:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.135@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787823436.314749:0:6682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e79013a3c00/0x5d1142b8324814ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5d1142b8324814f6 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823436.314794:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e79013a3c00/0x5d1142b8324814ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5d1142b8324814f6 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823436.314801:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff8e79013a3c00/0x5d1142b8324814ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5d1142b8324814f6 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823436.314819:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787823436.314841:0:6682:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e7909bc2800 10000000:01000000:1.0:1787823436.314845:0:6682:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787823436.314850:0:6682:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8e7906ef0000 10000000:01000000:1.0:1787823436.314853:0:6682:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787823436.314856:0:6682:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8e7906ef0000 from 1 10000000:01000000:1.0:1787823436.314860:0:6682:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787823436.314885:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7901676000/0x5d1142b8324814fd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823436.314893:0:6682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e7901676000/0x5d1142b8324814fd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823436.314926:0:6682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e7901676000/0x5d1142b8324814fd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823436.314941:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790ae80b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651812992:0@lo:101: 00000100:00100000:1.0:1787823436.314983:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823436.315003:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908cbce40 going to sleep for 11 seconds 00010000:00010000:2.0:1787823436.315289:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787823436.315296:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e79013a3c00/0x5d1142b8324814ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5d1142b8324814f6 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823436.315305:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79013a3c00 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:2.0:1787823436.315309:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e79013a3c00/0x5d1142b8324814ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5d1142b8324814f6 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823436.315317:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e79013a3c00/0x5d1142b8324814ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x5d1142b8324814f6 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787823436.315324:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e79013a3c00/0x5d1142b8324814ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x5d1142b8324814f6 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787823436.315339:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787823436.315361:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e79013a3c00/0x5d1142b8324814ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5d1142b8324814f6 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823436.315367:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787823436.315394:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e79013a3c00/0x5d1142b8324814ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5d1142b8324814f6 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823436.315402:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e79013a3c00/0x5d1142b8324814ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5d1142b8324814f6 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823436.315420:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823436.315422:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823436.315431:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787823436.315442:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787823436.315458:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ac87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651813120:0@lo:103: 00000100:00100000:2.0:1787823436.315492:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823436.315525:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651813120 00000100:00100000:2.0:1787823436.315530:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651813120 00000100:00100000:2.0:1787823436.315572:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787823436.315580:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ac84f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+10:3307:x1874668651813120:12345-0@lo:103: 00010000:00010000:2.0:1787823436.315592:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787823436.315608:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7920eebc00/0x5d1142b8324814f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d1142b8324814ef expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823436.315622:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787823436.315651:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ac84f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+9:3307:x1874668651813120:12345-0@lo:103: Request processed in 71us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823436.315657:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787823436.315674:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651812992 00000100:00100000:2.0:1787823436.315677:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651812992 00000100:00100000:2.0:1787823436.315693:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787823436.315698:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+9:6682:x1874668651812992:12345-0@lo:101: 00010000:00010000:2.0:1787823436.315709:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823436.315722:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e79013a2e00/0x5d1142b832481504 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b8324814fd expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823436.315742:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e79013a2e00/0x5d1142b832481504 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b8324814fd expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823436.315752:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e79013a2e00/0x5d1142b832481504 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b8324814fd expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823436.315818:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79013a2e00, rc 0) 00000100:00100000:2.0:1787823436.315850:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+10:6682:x1874668651812992:12345-0@lo:101: Request processed in 151us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823436.315856:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787823436.315892:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ac87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651813120:0@lo:103: 00000100:00100000:1.0:1787823436.316012:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790ae80b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651812992:0@lo:101: 00010000:00010000:1.0:1787823436.316026:0:6682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e7901676000/0x5d1142b8324814fd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481504 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823436.316034:0:6682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e7901676000/0x5d1142b8324814fd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b832481504 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787823436.316052:0:6682:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787823436.316067:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7901676000/0x5d1142b8324814fd lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481504 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823436.316075:0:6682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e7901676000/0x5d1142b8324814fd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481504 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787823436.316083:0:6682:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787823436.316088:0:6682:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787823436.316093:0:6682:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787823436.316095:0:6682:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787823436.316112:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7901676c00/0x5d1142b83248150b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823436.316249:0:6682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e7901676c00/0x5d1142b83248150b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823436.316266:0:6682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e7901676c00/0x5d1142b83248150b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823436.316280:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790ae80b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651813248:0@lo:101: 00000100:00100000:1.0:1787823436.316308:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823436.316329:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908cbce40 going to sleep for 11 seconds 00000100:00100000:2.0:1787823436.316510:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651813248 00000100:00100000:2.0:1787823436.316515:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651813248 00000100:00100000:2.0:1787823436.316536:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787823436.316543:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+10:6682:x1874668651813248:12345-0@lo:101: 00010000:00010000:2.0:1787823436.316551:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823436.316561:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e79013a3000/0x5d1142b832481512 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b83248150b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823436.316573:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e79013a3000/0x5d1142b832481512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b83248150b expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823436.316582:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e79013a3000/0x5d1142b832481512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b83248150b expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823436.316588:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79013a3000, rc 0) 00000100:00100000:2.0:1787823436.316741:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+11:6682:x1874668651813248:12345-0@lo:101: Request processed in 197us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823436.316747:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787823436.317057:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790ae80b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651813248:0@lo:101: 00010000:00010000:1.0:1787823436.317069:0:6682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e7901676c00/0x5d1142b83248150b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481512 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823436.317077:0:6682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e7901676c00/0x5d1142b83248150b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b832481512 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823436.317257:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790ae80b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651813376:0@lo:501: 00000100:00100000:1.0:1787823436.317287:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823436.317429:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908cbce40 going to sleep for 11 seconds 00000100:00100000:0.0:1787823436.317471:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651813376 00000100:00100000:0.0:1787823436.317476:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651813376 00000100:00100000:0.0:1787823436.317545:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787823436.317554:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+11:6682:x1874668651813376:12345-0@lo:501: 00000100:00100000:0.0:1787823436.317837:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+11:6682:x1874668651813376:12345-0@lo:501: Request processed in 285us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823436.317855:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787823436.317936:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790ae80b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651813376:0@lo:501: 00000100:00100000:1.0:1787823436.317981:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790ae80b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651813504:0@lo:503: 00000100:00100000:1.0:1787823436.318022:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823436.318450:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908cbce40 going to sleep for 11 seconds 00000100:00100000:2.0:1787823436.318522:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651813504 00000100:00100000:2.0:1787823436.318527:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651813504 00000100:00100000:3.0:1787823436.318670:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787823436.318678:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+11:6682:x1874668651813504:12345-0@lo:503: 00000100:00100000:3.0:1787823436.318887:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+11:6682:x1874668651813504:12345-0@lo:503: Request processed in 209us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823436.318894:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787823436.319018:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790ae80b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651813504:0@lo:503: 00000040:00080000:1.0:1787823436.319501:0:6682:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787823436.319567:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790ae80b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651813632:0@lo:502: 00000100:00100000:1.0:1787823436.319611:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823436.320141:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908cbce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787823436.320260:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651813632 00000100:00100000:3.0:1787823436.320266:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651813632 00000100:00100000:2.0:1787823436.320321:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787823436.320344:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+11:6682:x1874668651813632:12345-0@lo:502: 00000100:00100000:2.0:1787823436.320539:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+11:6682:x1874668651813632:12345-0@lo:502: Request processed in 209us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823436.320547:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787823436.320697:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790ae80b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651813632:0@lo:502: 00000040:00080000:1.0:1787823436.321034:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787823436.321088:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787823436.321246:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787823436.321326:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787823436.321441:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787823436.321476:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787823436.321514:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790ae80b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651813760:0@lo:502: 00000100:00100000:1.0:1787823436.321572:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823436.321599:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908cbce40 going to sleep for 11 seconds 00000100:00100000:2.0:1787823436.321814:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651813760 00000100:00100000:2.0:1787823436.321820:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651813760 00000100:00100000:2.0:1787823436.321858:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787823436.321867:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+11:6682:x1874668651813760:12345-0@lo:502: 00000100:00100000:2.0:1787823436.322243:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+11:6682:x1874668651813760:12345-0@lo:502: Request processed in 377us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823436.322252:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787823436.322427:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790ae80b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651813760:0@lo:502: 00000040:00080000:1.0:1787823436.322541:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787823436.322552:0:6682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1787823436.323322:0:6701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787823436.323402:0:6701:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1787823436.323410:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787823436.323413:0:6701:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787823436.323418:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787823436.323442:0:6701:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8e79036a4d70) 00000020:00000080:1.0:1787823436.323464:0:6701:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787823436.323470:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787823436.323544:0:6701:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e7909bc2800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787823436.323552:0:6701:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787823436.323559:0:6701:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5d1142b832481520 00010000:00010000:1.0:1787823436.329873:0:6701:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1787823436.330475:0:6701:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1787823436.333666:0:6701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787823436.334055:0:6701:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1787823436.343840:0:6701:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1787823436.344720:0:6701:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1787823436.347738:0:6701:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787823436.347752:0:6701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787823436.347791:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787823436.347794:0:6701:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787823436.347798:0:6701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787823436.347803:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787823436.347804:0:6701:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787823436.347807:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787823436.347809:0:6701:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787823436.347867:0:6701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787823436.347870:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787823436.347872:0:6701:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787823436.347875:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787823436.348218:0:6682:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1787823436.348242:0:6682:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787823436.348268:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7901676c00/0x5d1142b83248150b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481512 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823436.348281:0:6682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e7901676c00/0x5d1142b83248150b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481512 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787823436.348288:0:6682:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e7909bc2800 from 1 10000000:01000000:2.0:1787823436.348290:0:6682:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787823436.348326:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e79013a3c00/0x5d1142b832481527 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823436.348405:0:6682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e79013a3c00/0x5d1142b832481527 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823436.348418:0:6682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e79013a3c00/0x5d1142b832481527 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823436.348457:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ac87840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651813888:0@lo:101: 00000100:00100000:2.0:1787823436.348529:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823436.348595:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7918250f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787823436.350094:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651813888 00000100:00100000:1.0:1787823436.350113:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651813888 00000100:00100000:1.0:1787823436.350251:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787823436.350262:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+11:6682:x1874668651813888:12345-0@lo:101: 00010000:00010000:1.0:1787823436.350280:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823436.350303:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7901676200/0x5d1142b83248152e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b832481527 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823436.350428:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7901676200/0x5d1142b83248152e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b832481527 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823436.350444:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7901676200/0x5d1142b83248152e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832481527 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823436.350455:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7901676200, rc 0) 00000100:00100000:1.0:1787823436.350553:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:6682:x1874668651813888:12345-0@lo:101: Request processed in 292us (2023us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823436.350560:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787823436.352261:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ac87840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651813888:0@lo:101: 00010000:00010000:0.0:1787823436.352294:0:6682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e79013a3c00/0x5d1142b832481527 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248152e expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823436.352307:0:6682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e79013a3c00/0x5d1142b832481527 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b83248152e expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823436.353490:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651814016:0@lo:501: 00000100:00100000:0.0:1787823436.353561:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823436.354251:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79037f6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787823436.358274:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651814016 00000100:00100000:1.0:1787823436.358290:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651814016 00000100:00100000:1.0:1787823436.358415:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787823436.358428:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:6682:x1874668651814016:12345-0@lo:501: 00000100:00100000:1.0:1787823436.358826:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:6682:x1874668651814016:12345-0@lo:501: Request processed in 400us (5264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823436.358834:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787823436.363616:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651814016:0@lo:501: 00000100:00100000:1.0:1787823436.363799:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790ae80b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651814144:0@lo:503: 00000100:00100000:1.0:1787823436.363921:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823436.363989:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908cbce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787823436.364203:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651814144 00000100:00100000:3.0:1787823436.364210:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651814144 00000100:00100000:3.0:1787823436.364262:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787823436.364273:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:6682:x1874668651814144:12345-0@lo:503: 00000100:00100000:3.0:1787823436.364672:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:6682:x1874668651814144:12345-0@lo:503: Request processed in 398us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823436.364680:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787823436.365242:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790ae80b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651814144:0@lo:503: 00000040:00080000:1.0:1787823436.365642:0:6682:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787823436.365717:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790ae80b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651814272:0@lo:502: 00000100:00100000:1.0:1787823436.365803:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823436.365842:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908cbce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787823436.365926:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651814272 00000100:00100000:3.0:1787823436.365933:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651814272 00000100:00100000:3.0:1787823436.366111:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787823436.366198:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:6682:x1874668651814272:12345-0@lo:502: 00000100:00100000:3.0:1787823436.366547:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:6682:x1874668651814272:12345-0@lo:502: Request processed in 425us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823436.366555:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787823436.366737:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790ae80b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651814272:0@lo:502: 00000040:00080000:0.0:1787823436.367269:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787823436.367491:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787823436.367538:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651814400:0@lo:502: 00000100:00100000:0.0:1787823436.367596:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823436.367627:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79037f6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787823436.367731:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651814400 00000100:00100000:1.0:1787823436.367738:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651814400 00000100:00100000:1.0:1787823436.367799:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787823436.367809:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:6682:x1874668651814400:12345-0@lo:502: 00000100:00100000:0.0:1787823436.368502:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651814400:0@lo:502: 00000040:00080000:0.0:1787823436.368628:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787823436.368640:0:6682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000100:00100000:1.0:1787823436.368884:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:6682:x1874668651814400:12345-0@lo:502: Request processed in 1077us (1287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823436.368894:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000020:01000000:1.0:1787823436.370447:0:6705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787823436.370460:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787823436.370462:0:6705:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787823436.370469:0:6705:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e7909bc2800 00000020:00000080:1.0:1787823436.370471:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787823436.370504:0:6705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787823436.370508:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787823436.370509:0:6705:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787823436.370512:0:6705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787823436.370701:0:6682:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787823436.370728:0:6682:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787823436.370748:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e79013a3c00/0x5d1142b832481527 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248152e expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823436.370785:0:6682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e79013a3c00/0x5d1142b832481527 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248152e expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787823436.370831:0:6682:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787823436.370834:0:6682:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e7909bc2800 10000000:01000000:0.0:1787823436.370837:0:6682:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e7909bc2800 10000000:01000000:0.0:1787823436.370841:0:6682:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787823436.370846:0:6682:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e7909bc2800 from 1 10000000:01000000:0.0:1787823436.370849:0:6682:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787823436.370883:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7900031800/0x5d1142b832481535 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823436.370892:0:6682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e7900031800/0x5d1142b832481535 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823436.370902:0:6682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e7900031800/0x5d1142b832481535 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823436.370935:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651814528:0@lo:101: 00000100:00100000:0.0:1787823436.371006:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823436.371101:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651814528 00000100:00100000:3.0:1787823436.371108:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651814528 00000100:00100000:3.0:1787823436.371271:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787823436.371281:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:6682:x1874668651814528:12345-0@lo:101: 00010000:00010000:3.0:1787823436.371294:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823436.371306:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7920eeaa00/0x5d1142b83248153c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b832481535 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823436.371338:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7920eeaa00/0x5d1142b83248153c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b832481535 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823436.371349:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7920eeaa00/0x5d1142b83248153c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832481535 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823436.371356:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7920eeaa00, rc 0) 00000100:00100000:3.0:1787823436.371392:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:6682:x1874668651814528:12345-0@lo:101: Request processed in 112us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823436.371399:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787823436.371714:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79047a19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787823436.371738:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651814528:0@lo:101: 00010000:00010000:0.0:1787823436.371753:0:6682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e7900031800/0x5d1142b832481535 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248153c expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823436.371893:0:6682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e7900031800/0x5d1142b832481535 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b83248153c expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823436.372425:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790ae82940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651814656:0@lo:501: 00000100:00100000:1.0:1787823436.372487:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823436.372564:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79035e79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787823436.372601:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651814656 00000100:00100000:3.0:1787823436.372607:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651814656 00000100:00100000:3.0:1787823436.372676:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787823436.372686:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:6682:x1874668651814656:12345-0@lo:501: 00000100:00100000:3.0:1787823436.373299:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:6682:x1874668651814656:12345-0@lo:501: Request processed in 612us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823436.373307:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787823436.373436:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790ae82940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651814656:0@lo:501: 00000100:00100000:2.0:1787823436.373479:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ac87c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651814784:0@lo:503: 00000100:00100000:2.0:1787823436.373523:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823436.373647:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7918250f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787823436.373718:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651814784 00000100:00100000:3.0:1787823436.373723:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651814784 00000100:00100000:3.0:1787823436.373748:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787823436.373755:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:6682:x1874668651814784:12345-0@lo:503: 00000100:00100000:3.0:1787823436.373957:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:6682:x1874668651814784:12345-0@lo:503: Request processed in 201us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823436.373974:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787823436.374260:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ac87c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651814784:0@lo:503: 00000040:00080000:2.0:1787823436.374558:0:6682:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787823436.374619:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ac87c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651814912:0@lo:502: 00000100:00100000:2.0:1787823436.374665:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823436.374681:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908ffc000 going to sleep for 11 seconds 00000100:00100000:3.0:1787823436.374840:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651814912 00000100:00100000:3.0:1787823436.374845:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651814912 00000100:00100000:3.0:1787823436.374873:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787823436.374881:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:6682:x1874668651814912:12345-0@lo:502: 00000100:00100000:3.0:1787823436.375231:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:6682:x1874668651814912:12345-0@lo:502: Request processed in 348us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823436.375239:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787823436.375387:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ac87c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651814912:0@lo:502: 00000040:00080000:2.0:1787823436.375651:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787823436.375704:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787823436.375738:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787823436.376323:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787823436.376455:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787823436.376507:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787823436.376544:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787823436.376576:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787823436.376623:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787823436.376658:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787823436.376690:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787823436.376737:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787823436.377284:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787823436.377346:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787823436.377427:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787823436.377468:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787823436.377503:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787823436.377548:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787823436.377583:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787823436.377630:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787823436.379109:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787823436.379243:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787823436.379275:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787823436.379322:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787823436.379448:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1787823436.379485:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1787823436.379537:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1787823436.379573:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1787823436.379631:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ad52940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651815040:0@lo:502: 00000100:00100000:3.0:1787823436.379728:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823436.379956:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7909a440c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787823436.380486:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651815040 00000100:00100000:1.0:1787823436.380495:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651815040 00000100:00100000:0.0:1787823436.380592:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787823436.380605:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:6682:x1874668651815040:12345-0@lo:502: 00000100:00100000:0.0:1787823436.381477:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:6682:x1874668651815040:12345-0@lo:502: Request processed in 870us (1744us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823436.381497:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787823436.381622:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ad52940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651815040:0@lo:502: 00000040:00080000:3.0:1787823436.381741:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1787823436.381784:0:6682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1787823436.383604:0:6706:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787823436.383624:0:6706:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8e790370cd70) 00000020:00000080:3.0:1787823436.383647:0:6706:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1787823436.383728:0:6706:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e7909bc2800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787823436.383734:0:6706:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e7909bc2800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787823436.383736:0:6706:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e7909bc2800 3 00010000:00080000:3.0:1787823436.383821:0:6706:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e7801808800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.135@tcp at head 00010000:00010000:3.0:1787823436.386547:0:6706:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1787823436.386718:0:6706:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1787823436.386747:0:6706:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787823436.386777:0:6706:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5d1142b83248154a 00000100:00080000:3.0:1787823436.386787:0:6706:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787823436.386791:0:6706:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e7801808800 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:3.0:1787823436.386820:0:6706:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e791ad52940 x1874668651815168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787823436.386845:0:6706:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000040:00080000:3.0:1787823436.387068:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1787823436.388792:0:6682:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1787823436.388822:0:6682:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787823436.388841:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7900031800/0x5d1142b832481535 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248153c expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823436.388853:0:6682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e7900031800/0x5d1142b832481535 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248153c expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787823436.388904:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787823436.388910:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787823436.388911:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787823436.388912:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787823436.388912:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787823436.388914:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787823436.388915:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787823436.388917:0:6682:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787823436.388918:0:6682:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787823436.388919:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787823436.388920:0:6682:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787823436.388924:0:6682:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1787823436.388926:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787823436.388927:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787823436.388928:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787823436.388929:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787823436.388929:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787823436.388930:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787823436.388931:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787823436.388932:0:6682:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787823436.388933:0:6682:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787823436.388934:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787823436.388934:0:6682:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787823436.388956:0:6682:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787823436.388972:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ac87c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651815296:0@lo:253: 00000100:00100000:2.0:1787823436.389040:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823436.397247:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e791a680600 going to sleep for 11 seconds 00000100:00100000:2.0:1787823436.397985:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ad52940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1874668651815168:0@lo:38: 00000100:00100000:2.0:1787823436.398098:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823436.398144:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787823436.398153:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ac84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874668651815424:0@lo:400: 00000100:00100000:2.0:1787823436.398201:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823436.398843:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651815168 00000100:00100000:3.0:1787823436.398856:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651815168 00000100:00100000:3.0:1787823436.398919:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651815424 00000100:00100000:3.0:1787823436.398922:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651815424 00000100:00100000:3.0:1787823436.398955:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787823436.399078:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ac84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874668651815424:12345-0@lo:400: 00000100:00100000:3.0:1787823436.399217:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ac84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874668651815424:12345-0@lo:400: Request processed in 253us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823436.399225:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787823436.399244:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787823436.399248:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ac85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1874668651815168:12345-0@lo:38: 00010000:00080000:3.0:1787823436.399272:0:5838:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:3.0:1787823436.399308:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5d1142b832481551 00000004:00100000:3.0:1787823436.399323:0:5838:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787823436.399439:0:5838:0:(import.c:65:import_set_state_nolock()) ffff8e780180d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787823436.399482:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ac85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874668651815168:12345-0@lo:38: Request processed in 231us (1384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823436.399488:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787823436.399533:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e791ac84780 x1874668651815424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787823452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823436.399548:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ac84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874668651815424:0@lo:400: 00010000:00080000:3.0:1787823436.399586:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e791ad52940 x1874668651815168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787823446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823436.399609:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787823436.399616:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1787823436.399623:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787823436.399628:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787823436.399630:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8e7801808800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787823436.399636:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ad52940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1874668651815168:0@lo:38: 00000100:00100000:0.0:1787823436.400239:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651815296 00000100:00100000:0.0:1787823436.400247:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651815296 00000100:00100000:0.0:1787823436.400286:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787823436.400294:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:6682:x1874668651815296:12345-0@lo:253: 20000000:01000000:0.0:1787823436.400320:0:5831:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787823436.400444:0:5831:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787823436.437644:0:5831:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787823436.437664:0:5831:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787823436.437735:0:5854:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787823436.437740:0:5854:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787823436.437782:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e7920eea600/0x5d1142b832481558 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823436.437801:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e79013a2400/0x5d1142b8324814b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b8324814a9 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823436.437810:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e7920eea600/0x5d1142b832481558 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823436.437855:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e79013a2400/0x5d1142b8324814b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d1142b8324814a9 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823436.437869:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e79013a2400/0x5d1142b8324814b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d1142b8324814a9 expref: 13 pid: 5832 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823436.437882:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ad52940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1874668651815552:0@lo:104: 00000100:00100000:3.0:1787823436.437962:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823436.438019:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e790815fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787823436.438512:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651815552 00000100:00100000:2.0:1787823436.438520:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651815552 00000100:00100000:2.0:1787823436.438576:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787823436.438586:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ad53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+3:5854:x1874668651815552:12345-0@lo:104: 00010000:00010000:2.0:1787823436.438616:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff8e7900031400/0x5d1142b8324814a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b8324814b0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823436.438685:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787823436.438691:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ad53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+3:5854:x1874668651815552:12345-0@lo:104: Request processed in 108us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823436.438699:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1787823436.438724:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787823436.438730:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e7900031400/0x5d1142b8324814a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b8324814b0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823436.438738:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7900031400 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:2.0:1787823436.438742:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e7900031400/0x5d1142b8324814a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d1142b8324814b0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823436.438750:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e7900031400/0x5d1142b8324814a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d1142b8324814b0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787823436.438777:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e7900031400/0x5d1142b8324814a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d1142b8324814b0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787823436.438784:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787823436.438815:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e7900031400/0x5d1142b8324814a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b8324814b0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823436.438821:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787823436.438838:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e7900031400/0x5d1142b8324814a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b8324814b0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823436.438845:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e7900031400/0x5d1142b8324814a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b8324814b0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823436.438882:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823436.438883:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823436.438885:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823436.439077:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ad52940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1874668651815552:0@lo:104: 00010000:00010000:3.0:1787823436.439099:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e7920eea600/0x5d1142b832481558 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823436.439274:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ac86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651815680:0@lo:103: 00000100:00100000:2.0:1787823436.439323:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823436.439555:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651815680 00000100:00100000:3.0:1787823436.439560:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651815680 00010000:00010000:3.0:1787823436.439583:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e79013a2400/0x5d1142b8324814b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b8324814a9 expref: 14 pid: 5832 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823436.439614:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787823436.439622:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909a22850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:3306:x1874668651815680:12345-0@lo:103: 00010000:00010000:3.0:1787823436.439635:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787823436.439640:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e79013a2400/0x5d1142b8324814b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b8324814a9 expref: 14 pid: 5832 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823436.439653:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e79013a2400/0x5d1142b8324814b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d1142b8324814a9 expref: 14 pid: 5832 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823436.439669:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e79013a2400/0x5d1142b8324814b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d1142b8324814a9 expref: 14 pid: 5832 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823436.439684:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e7920eea600/0x5d1142b832481558 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823436.439691:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7920eea600/0x5d1142b832481558 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787823436.439705:0:5824:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006293270s 00010000:00010000:3.0:1787823436.439710:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7920eea600/0x5d1142b832481558 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823436.439718:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7920eea600/0x5d1142b832481558 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823436.439737:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e7920eea600/0x5d1142b832481558 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823436.439744:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e7920eea600/0x5d1142b832481558 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823436.439750:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eea600 already unused, calling callback (ffffffffc1649440) 00010000:00010000:3.0:1787823436.439755:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e7920eea600/0x5d1142b832481558 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823436.439807:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e7920eea600/0x5d1142b832481558 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823436.439821:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e7920eea600/0x5d1142b832481558 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823436.439831:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787823436.439868:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909a22850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:3306:x1874668651815680:12345-0@lo:103: Request processed in 247us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823436.439875:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1787823436.440080:0:5854:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e7920eea600/0x5d1142b832481558 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823436.440089:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e7920eea600/0x5d1142b832481558 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823436.440095:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7920eea600/0x5d1142b832481558 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823436.440462:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ac86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651815680:0@lo:103: 00000100:00100000:0.0:1787823436.456789:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:6682:x1874668651815296:12345-0@lo:253: Request processed in 56455us (67708us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823436.456809:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787823436.457096:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ac87c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:6682:1874668651815296:0@lo:253: 10000000:01000000:3.0:1787823436.457272:0:6682:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787823436.457275:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787823436.457277:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787823436.457280:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787823436.457281:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787823436.457282:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787823436.457284:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787823436.457285:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787823436.457286:0:6682:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787823436.457288:0:6682:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787823436.457289:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787823436.457290:0:6682:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787823436.457306:0:6682:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787823436.464561:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787823436.464807:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787823436.465503:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787823436.465695:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787823436.466275:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787823436.466640:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787823436.468648:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1787823436.692449:0:6682:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787823436.692454:0:6682:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787823436.692481:0:6682:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787823436.692527:0:6682:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.135@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787823436.692541:0:6682:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787823436.692564:0:6682:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1787823437.039437:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823438.060740:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823439.082556:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823440.109099:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823441.131484:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823441.903537:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651815808:0@lo:400: 00000100:00100000:3.0:1787823441.903607:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823441.903865:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874668651815936:0@lo:400: 00000100:00100000:1.0:1787823441.903902:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823441.910008:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651815808 00000100:00100000:3.0:1787823441.910023:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651815808 00000100:00100000:3.0:1787823441.910359:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787823441.910369:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903726450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:3307:x1874668651815808:12345-0@lo:400: 00000100:00100000:3.0:1787823441.910476:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903726450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:3307:x1874668651815808:12345-0@lo:400: Request processed in 108us (6868us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823441.910484:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787823441.910522:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651815936 00000100:00100000:3.0:1787823441.910528:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651815936 00000100:00100000:3.0:1787823441.910562:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787823441.910570:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790ae803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874668651815936:12345-0@lo:400: 00000100:00100000:3.0:1787823441.910611:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790ae803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874668651815936:12345-0@lo:400: Request processed in 41us (6707us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823441.910617:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787823441.911949:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874668651816064:0@lo:400: 00000100:00100000:2.0:1787823441.912004:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823441.912409:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651816064 00000100:00100000:3.0:1787823441.912416:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651816064 00000100:00100000:3.0:1787823441.912469:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787823441.912478:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ac84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874668651816064:12345-0@lo:400: 00000100:00100000:3.0:1787823441.912524:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ac84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874668651816064:12345-0@lo:400: Request processed in 48us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823441.912531:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787823441.912596:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e790aef30c0 x1874668651815936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787823457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823441.912610:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874668651815936:0@lo:400: 00010000:00080000:2.0:1787823441.912965:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e790aef3840 x1874668651816064/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787823457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823441.912976:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874668651816064:0@lo:400: 00000100:00080000:3.0:1787823441.913402:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787823441.913428:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651815808:0@lo:400: 00010000:00010000:3.0:1787823442.153991:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823443.193412:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787823443.694552:0:7049:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg235-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787823444.202077:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787823444.983552:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787823444.983560:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e79034dc800 from 21 10000000:01000000:2.0:1787823444.983566:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787823444.983650:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e79013a2400/0x5d1142b83248155f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823444.983663:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e79013a2400/0x5d1142b83248155f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823444.983685:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e79013a2400/0x5d1142b83248155f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823444.983742:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ac86580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651816192:0@lo:101: 00000100:00100000:2.0:1787823444.983899:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823444.987953:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e791004ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1787823444.990953:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651816192 00000100:00100000:0.0:1787823444.990969:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651816192 00000100:00100000:0.0:1787823444.991029:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787823444.991041:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:5835:x1874668651816192:12345-0@lo:101: 00010000:00010000:0.0:1787823444.991058:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823444.991075:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7900030400/0x5d1142b832481566 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b83248155f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823444.991104:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7900030400/0x5d1142b832481566 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b83248155f expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823444.991125:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7900030400/0x5d1142b832481566 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b83248155f expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823444.991134:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7900030400, rc 0) 00000100:00100000:0.0:1787823444.991216:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:5835:x1874668651816192:12345-0@lo:101: Request processed in 178us (7317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823444.991236:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787823444.991573:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ac86580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651816192:0@lo:101: 00010000:00010000:0.0:1787823444.991591:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e79013a2400/0x5d1142b83248155f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481566 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823444.991601:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e79013a2400/0x5d1142b83248155f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b832481566 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823444.991671:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651816320:0@lo:501: 00000100:00100000:0.0:1787823444.991704:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823444.991743:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7905275cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787823444.992464:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651816320 00000100:00100000:3.0:1787823444.992472:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651816320 00000100:00100000:3.0:1787823444.992512:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787823444.992521:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:5835:x1874668651816320:12345-0@lo:501: 00000100:00100000:3.0:1787823444.994494:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:5835:x1874668651816320:12345-0@lo:501: Request processed in 1963us (2777us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823444.994507:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787823444.994659:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651816320:0@lo:501: 00000100:00100000:1.0:1787823444.994714:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790ae82580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651816448:0@lo:503: 00000100:00100000:1.0:1787823444.994788:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823444.994820:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a79dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787823444.995431:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651816448 00000100:00100000:3.0:1787823444.995439:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651816448 00000100:00100000:3.0:1787823444.995503:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787823444.995512:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903727450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:5835:x1874668651816448:12345-0@lo:503: 00000100:00100000:3.0:1787823444.997601:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903727450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:5835:x1874668651816448:12345-0@lo:503: Request processed in 2079us (2802us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823444.997616:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787823445.008001:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790ae82580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651816448:0@lo:503: 00000100:00100000:1.0:1787823445.011422:0:7115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790ae82580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7115:1874668651816576:0@lo:502: 00000100:00100000:1.0:1787823445.011515:0:7115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823445.011562:0:7115:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a79d480 going to sleep for 11 seconds 00000100:00100000:3.0:1787823445.012659:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651816576 00000100:00100000:3.0:1787823445.012668:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651816576 00000100:00100000:3.0:1787823445.012717:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787823445.012727:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903727850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:7115:x1874668651816576:12345-0@lo:502: 00000100:00100000:3.0:1787823445.015710:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903727850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:7115:x1874668651816576:12345-0@lo:502: Request processed in 2973us (4183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823445.015725:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787823445.016003:0:7115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790ae82580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7115:1874668651816576:0@lo:502: 00000100:00100000:0.0:1787823445.016076:0:7115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7115:1874668651816704:0@lo:502: 00000100:00100000:0.0:1787823445.016136:0:7115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823445.016163:0:7115:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7905275cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787823445.018049:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651816704 00000100:00100000:3.0:1787823445.018061:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651816704 00000100:00100000:3.0:1787823445.018133:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787823445.018143:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903724450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:7115:x1874668651816704:12345-0@lo:502: 00000100:00100000:3.0:1787823445.019109:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903724450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:7115:x1874668651816704:12345-0@lo:502: Request processed in 962us (2967us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823445.019144:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787823445.019366:0:7115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7115:1874668651816704:0@lo:502: 00000040:00080000:0.0:1787823445.019405:0:7115:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1787823445.019468:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1787823445.019490:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787823445.019499:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e79013a2400/0x5d1142b83248155f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481566 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823445.019510:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e79013a2400/0x5d1142b83248155f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481566 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787823445.019519:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787823445.019529:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e79034dc800 from 4 10000000:01000000:0.0:1787823445.019532:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787823445.019563:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7900031400/0x5d1142b83248156d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823445.019571:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e7900031400/0x5d1142b83248156d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823445.019581:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e7900031400/0x5d1142b83248156d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823445.019596:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651816832:0@lo:101: 00000100:00100000:0.0:1787823445.019632:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823445.019674:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7907d1f480 going to sleep for 11 seconds 00000100:00100000:3.0:1787823445.020076:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651816832 00000100:00100000:3.0:1787823445.020083:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651816832 00000100:00100000:3.0:1787823445.020135:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787823445.020144:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:5835:x1874668651816832:12345-0@lo:101: 00010000:00010000:3.0:1787823445.020156:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823445.020172:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7920eea200/0x5d1142b832481574 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b83248156d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823445.020197:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7920eea200/0x5d1142b832481574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b83248156d expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823445.020209:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7920eea200/0x5d1142b832481574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b83248156d expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823445.020219:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7920eea200, rc 0) 00000100:00100000:3.0:1787823445.020272:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:5835:x1874668651816832:12345-0@lo:101: Request processed in 129us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823445.020279:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787823445.021109:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651816832:0@lo:101: 00010000:00010000:0.0:1787823445.021138:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e7900031400/0x5d1142b83248156d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481574 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823445.021147:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e7900031400/0x5d1142b83248156d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b832481574 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823445.021202:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651816960:0@lo:256: 00000100:00100000:0.0:1787823445.021244:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823445.021431:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7907d1f480 going to sleep for 11 seconds 00000100:00100000:0.0:1787823445.021449:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651816960 00000100:00100000:0.0:1787823445.021453:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651816960 00000100:00100000:0.0:1787823445.021488:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787823445.021496:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903726850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:5835:x1874668651816960:12345-0@lo:256: 20000000:01000000:0.0:1787823445.021512:0:5831:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787823445.021532:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787823445.021536:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1787823445.021615:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903726850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:5835:x1874668651816960:12345-0@lo:256: Request processed in 120us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823445.021623:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787823445.021656:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651816960:0@lo:256: 10000000:01000000:0.0:1787823445.021696:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787823445.021703:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7900031400/0x5d1142b83248156d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481574 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823445.021711:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e7900031400/0x5d1142b83248156d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481574 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787823445.021718:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787823445.021721:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1787823445.021723:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787823445.021746:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7900031000/0x5d1142b83248157b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823445.021753:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e7900031000/0x5d1142b83248157b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823445.021783:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e7900031000/0x5d1142b83248157b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823445.021796:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651817088:0@lo:101: 00000100:00100000:0.0:1787823445.021820:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823445.022946:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7907d1f480 going to sleep for 11 seconds 00000100:00100000:0.0:1787823445.022978:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651817088 00000100:00100000:0.0:1787823445.022985:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651817088 00000100:00100000:0.0:1787823445.023042:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787823445.023328:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:5835:x1874668651817088:12345-0@lo:101: 00010000:00010000:0.0:1787823445.023343:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823445.023361:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7900030800/0x5d1142b832481582 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b83248157b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823445.023389:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7900030800/0x5d1142b832481582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b83248157b expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823445.023400:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7900030800/0x5d1142b832481582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b83248157b expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823445.023409:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7900030800, rc 0) 00000100:00100000:0.0:1787823445.024375:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+15:5835:x1874668651817088:12345-0@lo:101: Request processed in 1320us (2547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823445.024385:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787823445.032005:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651817088:0@lo:101: 00010000:00010000:3.0:1787823445.032048:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e7900031000/0x5d1142b83248157b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481582 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823445.032063:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e7900031000/0x5d1142b83248157b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b832481582 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823445.032166:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ad52580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651817216:0@lo:501: 00000100:00100000:3.0:1787823445.032231:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823445.032974:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79047a13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787823445.033004:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651817216 00000100:00100000:3.0:1787823445.033010:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651817216 00000100:00100000:3.0:1787823445.033054:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787823445.033064:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+15:5835:x1874668651817216:12345-0@lo:501: 00000100:00100000:3.0:1787823445.033421:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+15:5835:x1874668651817216:12345-0@lo:501: Request processed in 358us (1189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823445.033428:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787823445.033493:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ad52580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651817216:0@lo:501: 00000100:00100000:3.0:1787823445.033528:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ad52580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651817344:0@lo:503: 00000100:00100000:3.0:1787823445.033571:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823445.033594:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79047a13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787823445.033938:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651817344 00000100:00100000:1.0:1787823445.033944:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651817344 00000100:00100000:1.0:1787823445.033975:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787823445.033981:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+15:5835:x1874668651817344:12345-0@lo:503: 00000100:00100000:1.0:1787823445.034375:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+15:5835:x1874668651817344:12345-0@lo:503: Request processed in 393us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823445.034383:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787823445.034427:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ad52580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651817344:0@lo:503: 00000100:00100000:1.0:1787823445.034614:0:7116:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790ae82580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7116:1874668651817472:0@lo:502: 00000100:00100000:1.0:1787823445.034650:0:7116:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823445.034674:0:7116:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a79d780 going to sleep for 11 seconds 00000100:00100000:3.0:1787823445.035480:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651817472 00000100:00100000:3.0:1787823445.035491:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651817472 00000100:00100000:3.0:1787823445.035528:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787823445.035537:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7908c44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+15:7116:x1874668651817472:12345-0@lo:502: 00000100:00100000:3.0:1787823445.043557:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7908c44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+15:7116:x1874668651817472:12345-0@lo:502: Request processed in 8009us (8894us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823445.043571:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787823445.047392:0:7116:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790ae82580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7116:1874668651817472:0@lo:502: 00000020:01000000:2.0:1787823445.047511:0:7116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787823445.047519:0:7116:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787823445.047527:0:7116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787823445.047530:0:7116:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787823445.047534:0:7116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787823445.047537:0:7116:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.135@tcp to nid 0x20000c0a8ca87 (192.168.202.135@tcp) 00000020:01000000:2.0:1787823445.047560:0:7116:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787823445.047562:0:7116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787823445.047590:0:7116:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8e7906f48000) 00000020:00000080:2.0:1787823445.047611:0:7116:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1787823445.047618:0:7116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787823445.050036:0:7116:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787823445.050049:0:7116:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787823445.050063:0:7116:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d1142b832481590 00010000:00080000:2.0:1787823445.050104:0:7116:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e7939edb000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.135@tcp at head 00010000:00010000:2.0:1787823445.050650:0:7116:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1787823445.100055:0:7116:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787823445.100086:0:7116:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787823445.100658:0:7116:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787823445.100878:0:7116:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787823445.100931:0:7116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1787823445.100988:0:7116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1787823445.101635:0:7122:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787823445.101641:0:7122:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787823445.102490:0:7116:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787823445.102504:0:7116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787823445.102540:0:7116:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787823445.102563:0:7116:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d1142b832481597 00000100:00080000:3.0:1787823445.102576:0:7116:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787823445.102583:0:7116:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e7939edb000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:3.0:1787823445.102623:0:7116:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e791ad52580 x1874668651817600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787823445.102665:0:7116:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1787823445.102868:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ad52580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874668651817600:0@lo:8: 00000100:00100000:2.0:1787823445.102946:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823445.103032:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651817600 00000100:00100000:2.0:1787823445.103040:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651817600 00000100:00100000:2.0:1787823445.103075:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787823445.103084:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ac843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1874668651817600:12345-0@lo:8: 00010000:00080000:2.0:1787823445.103127:0:6686:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:2.0:1787823445.103160:0:6686:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d1142b83248159e 00002000:00100000:2.0:1787823445.103190:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8e79378e7000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787823445.103195:0:6686:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1787823445.103199:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787823445.103525:0:6686:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787823445.103686:0:6686:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787823445.103719:0:6686:0:(import.c:65:import_set_state_nolock()) ffff8e79378e5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787823445.103803:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ac843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1874668651817600:12345-0@lo:8: Request processed in 718us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823445.103811:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787823445.103850:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e791ad52580 x1874668651817600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787823455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823445.103861:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787823445.103870:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787823445.103878:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787823445.103884:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787823445.103886:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8e7939edb000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787823445.103899:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787823445.103903:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ad52580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874668651817600:0@lo:8: 00000004:00080000:2.0:1787823445.103933:0:7122:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787823445.104034:0:7122:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 185958275134ns, next at 0ns, rc = 0 00000020:01000000:3.0:1787823445.104548:0:7116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787823445.104555:0:7116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787823445.104558:0:7116:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787823445.104562:0:7116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787823445.104566:0:7116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787823445.104568:0:7116:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787823445.104571:0:7116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787823445.104573:0:7116:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787823445.104606:0:7116:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ad52d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7116:1874668651817728:0@lo:502: 00000100:00100000:3.0:1787823445.104691:0:7116:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823445.104720:0:7116:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79047a10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787823445.105291:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651817728 00000100:00100000:1.0:1787823445.105299:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651817728 00000100:00100000:1.0:1787823445.105347:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787823445.105358:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7908c45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+15:7116:x1874668651817728:12345-0@lo:502: 00000100:00100000:1.0:1787823445.105583:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7908c45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+15:7116:x1874668651817728:12345-0@lo:502: Request processed in 227us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823445.105591:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787823445.105888:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790ae82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874668651817856:0@lo:400: 00000100:00100000:1.0:1787823445.105922:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823445.105999:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790ae80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874668651817984:0@lo:400: 00000100:00100000:1.0:1787823445.106038:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823445.106279:0:7116:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ad52d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7116:1874668651817728:0@lo:502: 00000020:01000000:1.0:1787823445.106317:0:7116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787823445.106323:0:7116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787823445.106326:0:7116:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787823445.106330:0:7116:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1787823445.106454:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1787823445.106471:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787823445.106480:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7900031000/0x5d1142b83248157b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481582 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823445.106491:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e7900031000/0x5d1142b83248157b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481582 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787823445.106507:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787823445.106509:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e7906ef0000 from 1 10000000:01000000:1.0:1787823445.106512:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787823445.106541:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b8324815a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823445.106549:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b8324815a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823445.106559:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b8324815a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823445.106574:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790ae80b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651818112:0@lo:101: 00000100:00100000:1.0:1787823445.106604:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823445.106630:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79046fd0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787823445.106645:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651818112 00000100:00100000:1.0:1787823445.106649:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651818112 00000100:00100000:1.0:1787823445.106856:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787823445.106865:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+15:5835:x1874668651818112:12345-0@lo:101: 00010000:00010000:1.0:1787823445.106876:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823445.106888:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7901677200/0x5d1142b8324815ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b8324815a5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823445.106908:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7901677200/0x5d1142b8324815ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b8324815a5 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823445.106917:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7901677200/0x5d1142b8324815ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b8324815a5 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823445.106937:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7901677200, rc 0) 00000100:00100000:1.0:1787823445.106972:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+16:5835:x1874668651818112:12345-0@lo:101: Request processed in 108us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823445.106977:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787823445.107012:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790ae80b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651818112:0@lo:101: 00010000:00010000:1.0:1787823445.107024:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b8324815a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324815ac expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823445.107032:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b8324815a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b8324815ac expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823445.107071:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790ae80b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651818240:0@lo:501: 00000100:00100000:1.0:1787823445.107096:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823445.107124:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79046fd0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787823445.107138:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651818240 00000100:00100000:1.0:1787823445.107142:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651818240 00000100:00100000:1.0:1787823445.107164:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787823445.107171:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+16:5835:x1874668651818240:12345-0@lo:501: 00000100:00100000:1.0:1787823445.107408:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+16:5835:x1874668651818240:12345-0@lo:501: Request processed in 237us (310us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787823445.107415:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787823445.107445:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790ae80b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651818240:0@lo:501: 10000000:01000000:1.0:1787823445.107464:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787823445.107469:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b8324815a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324815ac expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823445.107487:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b8324815a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324815ac expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823445.111868:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651817856 00000100:00100000:2.0:1787823445.111891:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651817856 00000100:00100000:2.0:1787823445.111955:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651817984 00000100:00100000:2.0:1787823445.111959:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651817984 00000100:00100000:2.0:1787823445.111992:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787823445.112001:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790ae81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874668651817856:12345-0@lo:400: 00000100:00100000:2.0:1787823445.112090:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790ae81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874668651817856:12345-0@lo:400: Request processed in 90us (6167us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823445.112097:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787823445.112127:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787823445.112134:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790ae82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874668651817984:12345-0@lo:400: 00000100:00100000:2.0:1787823445.112168:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790ae82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874668651817984:12345-0@lo:400: Request processed in 35us (6129us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823445.112174:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787823445.112216:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e790ae82d00 x1874668651817856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787823461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823445.112230:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790ae82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874668651817856:0@lo:400: 00010000:00080000:2.0:1787823445.112263:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e790ae80780 x1874668651817984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787823461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823445.112273:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790ae80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874668651817984:0@lo:400: 00000100:00080000:3.0:1787823445.112910:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1787823445.184521:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1787823445.212637:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651818368:0@lo:13: 00000100:00100000:1.0:1787823445.212719:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823445.212840:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651818368 00000100:00100000:2.0:1787823445.212848:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651818368 00000100:00100000:2.0:1787823445.212911:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787823445.212921:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790ae80b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1874668651818368:12345-0@lo:13: 00002000:00000024:2.0:1787823445.212952:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00080000:3.0:1787823445.213015:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1787823445.213074:0:7123:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787823445.213097:0:7123:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef03c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7123:1874668651818496:0@lo:7: 00000100:00100000:0.0:1787823445.213140:0:7123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823445.213163:0:7123:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908c15900 going to sleep for 11 seconds 00000100:00100000:2.0:1787823445.213347:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790ae80b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1874668651818368:12345-0@lo:13: Request processed in 427us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823445.213369:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787823445.213396:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651818496 00000100:00100000:2.0:1787823445.213400:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651818496 00000100:00100000:2.0:1787823445.213471:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787823445.213479:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790aef1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7123:x1874668651818496:12345-0@lo:7: 00010000:00080000:1.0:1787823445.215184:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e790aef0b40 x1874668651818368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823461 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787823445.215211:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651818368:0@lo:13: 00002000:00080000:3.0:1787823445.220435:0:6688:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1787823445.220444:0:6688:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787823445.225898:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790aef1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7123:x1874668651818496:12345-0@lo:7: Request processed in 12280us (12617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823445.225920:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787823445.227206:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1787823445.231604:0:7123:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e790aef03c0 x1874668651818496/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787823461 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823445.231627:0:7123:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef03c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7123:1874668651818496:0@lo:7: 00000004:00080000:2.0:1787823445.231642:0:7123:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787823445.231685:0:7123:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ac86580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7123:1874668651818624:0@lo:5: 00000100:00100000:2.0:1787823445.231753:0:7123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823445.231832:0:7123:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e791004e240 going to sleep for 11 seconds 00000100:00100000:0.0:1787823445.232577:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651818624 00000100:00100000:0.0:1787823445.232585:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651818624 00000100:00100000:0.0:1787823445.232643:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787823445.232655:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ac852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7123:x1874668651818624:12345-0@lo:5: 00002000:00080000:0.0:1787823445.232685:0:6686:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787823445.232689:0:6686:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1787823445.238270:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ac852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7123:x1874668651818624:12345-0@lo:5: Request processed in 5609us (6506us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787823445.238283:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787823445.238824:0:7123:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e791ac86580 x1874668651818624/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787823461 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823445.238843:0:7123:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ac86580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7123:1874668651818624:0@lo:5: 00000004:00080000:3.0:1787823445.238860:0:7123:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787823445.238897:0:7123:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ad52940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7123:1874668651818752:0@lo:700: 00000100:00100000:3.0:1787823445.238942:0:7123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823445.238985:0:7123:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79047a13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787823445.239068:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651818752 00000100:00100000:2.0:1787823445.239075:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651818752 00000100:00100000:2.0:1787823445.239131:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787823445.239140:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ad521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7123:x1874668651818752:12345-0@lo:700: 00000100:00100000:2.0:1787823445.239174:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ac86940 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6694:1874668651818880:0@lo:700: 00000100:00100000:2.0:1787823445.239204:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823445.239228:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e791004ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1787823445.239391:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651818880 00000100:00100000:0.0:1787823445.239396:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651818880 00000100:00100000:0.0:1787823445.239431:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787823445.239438:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ac861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6694:x1874668651818880:12345-0@lo:700: 40000000:02000000:0.0:1787823445.272382:0:5845:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1787823445.278521:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ac861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6694:x1874668651818880:12345-0@lo:700: Request processed in 39073us (39306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823445.278536:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787823445.278602:0:6694:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e791ac86940 x1874668651818880/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787823461 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823445.278618:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ac86940 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6694:1874668651818880:0@lo:700: 40000000:02000000:0.0:1787823445.278630:0:6694:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:3.0:1787823445.392369:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1787823445.392386:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787823445.392799:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ad521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7123:x1874668651818752:12345-0@lo:700: Request processed in 153654us (153850us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823445.392817:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787823445.393226:0:7123:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e791ad52940 x1874668651818752/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787823461 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823445.393237:0:7123:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787823445.393314:0:7123:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ad52940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7123:1874668651818752:0@lo:700: 00000004:02000040:3.0:1787823445.483298:0:7123:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1787823445.495211:0:7123:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ad52940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7123:1874668651819008:0@lo:5: 00000100:00100000:3.0:1787823445.495299:0:7123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823445.495355:0:7123:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79037986c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787823445.495417:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651819008 00000100:00100000:2.0:1787823445.495425:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651819008 00000100:00100000:2.0:1787823445.495492:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787823445.495501:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ad52d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7123:x1874668651819008:12345-0@lo:5: 00002000:00080000:3.0:1787823445.504022:0:6688:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787823445.504048:0:6688:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1787823445.514324:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ad52d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7123:x1874668651819008:12345-0@lo:5: Request processed in 18815us (19016us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787823445.514338:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787823445.514813:0:7123:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e791ad52940 x1874668651819008/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787823461 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823445.514858:0:7123:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ad52940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7123:1874668651819008:0@lo:5: 00000004:00080000:2.0:1787823445.514875:0:7123:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1787823446.250107:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823447.283808:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823448.316452:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787823449.076800:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1787823449.324265:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823450.346391:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823450.601976:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790ae81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651819136:0@lo:400: 00000100:00100000:1.0:1787823450.602048:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823450.602114:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787823450.602122:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790ae830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874668651819264:0@lo:400: 00000100:00100000:1.0:1787823450.602150:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823450.602177:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790ae80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651819520:0@lo:400: 00000100:00100000:1.0:1787823450.602204:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823450.602235:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787823450.602240:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790ae80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874668651819392:0@lo:400: 00000100:00100000:1.0:1787823450.602276:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823450.602310:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651819136 00000100:00100000:1.0:1787823450.602317:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651819136 00000100:00100000:1.0:1787823450.602364:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787823450.602373:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+16:3305:x1874668651819136:12345-0@lo:400: 00000100:00100000:1.0:1787823450.602425:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+16:3305:x1874668651819136:12345-0@lo:400: Request processed in 53us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823450.602442:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787823450.602494:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790ae81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651819136:0@lo:400: 00000100:00100000:0.0:1787823450.602697:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651819520 00000100:00100000:0.0:1787823450.602701:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651819520 00000100:00100000:0.0:1787823450.602743:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787823450.602751:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790ae82580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651819520:12345-0@lo:400: 00000100:00100000:0.0:1787823450.602822:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790ae82580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651819520:12345-0@lo:400: Request processed in 72us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823450.602828:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787823450.602844:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787823450.602878:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e790ae80780 x1874668651819520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823450.602900:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787823450.602911:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790ae80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651819520:0@lo:400: 00000100:00100000:1.0:1787823450.608378:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651819648:0@lo:13: 00000100:00100000:1.0:1787823450.608472:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823450.609086:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651819264 00000100:00100000:1.0:1787823450.609096:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651819264 00000100:00100000:1.0:1787823450.609148:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651819392 00000100:00100000:1.0:1787823450.609152:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651819392 00000100:00100000:1.0:1787823450.609181:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787823450.609189:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790ae82d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874668651819264:12345-0@lo:400: 00000100:00100000:1.0:1787823450.609269:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790ae82d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874668651819264:12345-0@lo:400: Request processed in 80us (7117us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823450.609277:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787823450.609294:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787823450.609301:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792eb052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874668651819392:12345-0@lo:400: 00000100:00100000:1.0:1787823450.609334:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792eb052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874668651819392:12345-0@lo:400: Request processed in 34us (7058us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823450.609340:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1787823450.609386:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e790ae830c0 x1874668651819264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787823466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787823450.609400:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790ae830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874668651819264:0@lo:400: 00000100:00100000:2.0:1787823450.610556:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651819648 00000100:00100000:2.0:1787823450.610565:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651819648 00000100:00100000:2.0:1787823450.610611:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787823450.610620:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792eb06d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651819648:12345-0@lo:13: 00002000:00000024:2.0:1787823450.610657:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787823450.610728:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792eb06d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651819648:12345-0@lo:13: Request processed in 108us (2254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823450.610735:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787823450.610792:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e790aef2d00 x1874668651819648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823466 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823450.610810:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651819648:0@lo:13: 00000100:00080000:0.0:1787823450.611383:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787823450.611413:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e790ae80f00 x1874668651819392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787823466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823450.611425:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790ae80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874668651819392:0@lo:400: 00010000:00010000:0.0:1787823451.371215:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823452.394082:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823453.418107:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823454.443150:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823455.471985:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787823455.723332:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ac87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651819776:0@lo:400: 00000100:00100000:2.0:1787823455.723413:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823455.723464:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787823455.723470:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ac84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651820160:0@lo:400: 00000100:00100000:2.0:1787823455.723496:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823455.723522:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ac87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874668651820032:0@lo:400: 00000100:00100000:2.0:1787823455.723546:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823455.723565:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787823455.723571:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ac84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874668651819904:0@lo:400: 00000100:00100000:2.0:1787823455.723591:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823455.723622:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651819776 00000100:00100000:2.0:1787823455.723639:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651819776 00000100:00100000:2.0:1787823455.723688:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787823455.723697:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+16:3306:x1874668651819776:12345-0@lo:400: 00000100:00100000:2.0:1787823455.723747:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+16:3306:x1874668651819776:12345-0@lo:400: Request processed in 50us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823455.723755:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787823455.723807:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651820032 00000100:00100000:2.0:1787823455.723811:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651820032 00000100:00100000:2.0:1787823455.723846:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651819904 00000100:00100000:2.0:1787823455.723849:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651819904 00000100:00100000:2.0:1787823455.723861:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787823455.723867:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ac86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874668651820032:12345-0@lo:400: 00000100:00100000:2.0:1787823455.723901:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ac86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874668651820032:12345-0@lo:400: Request processed in 34us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823455.723907:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787823455.723917:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787823455.723923:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ac86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874668651819904:12345-0@lo:400: 00000100:00100000:2.0:1787823455.724083:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ac86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874668651819904:12345-0@lo:400: Request processed in 159us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823455.724090:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1787823455.724114:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787823455.724140:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e791ac84780 x1874668651819904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787823471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823455.724154:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ac84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874668651819904:0@lo:400: 00010000:00080000:2.0:1787823455.724177:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e791ac87840 x1874668651820032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787823471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823455.724185:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ac87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874668651820032:0@lo:400: 00000100:00100000:2.0:1787823455.724223:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ac87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651819776:0@lo:400: 00000100:00100000:3.0:1787823455.724419:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651820160 00000100:00100000:3.0:1787823455.724424:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651820160 00000100:00100000:3.0:1787823455.724462:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787823455.724469:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ac87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651820160:12345-0@lo:400: 00000100:00100000:3.0:1787823455.724508:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ac87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651820160:12345-0@lo:400: Request processed in 40us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823455.724514:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787823455.724537:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787823455.724555:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ad52580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651820288:0@lo:13: 00000100:00100000:3.0:1787823455.724598:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823455.724630:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651820288 00000100:00100000:3.0:1787823455.724634:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651820288 00000100:00100000:3.0:1787823455.724655:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787823455.724661:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651820288:12345-0@lo:13: 00002000:00000024:3.0:1787823455.724686:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787823455.724715:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651820288:12345-0@lo:13: Request processed in 54us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823455.724721:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1787823455.724735:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787823455.724749:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e791ad52580 x1874668651820288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823471 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823455.724782:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ad52580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651820288:0@lo:13: 00010000:00080000:3.0:1787823455.724806:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e791ac84f00 x1874668651820160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823455.724815:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ac84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651820160:0@lo:400: 00000020:01000004:3.0:1787823456.218327:0:7623:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787823456.218331:0:7623:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1787823456.218468:0:7623:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e7903710800 00000020:01000004:3.0:1787823456.218487:0:7623:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787823456.218500:0:7623:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1787823456.218516:0:7623:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8e790370b3a0) 00000020:00000080:3.0:1787823456.218534:0:7623:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787823456.233270:0:7623:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1787823456.233620:0:7623:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1787823456.255218:0:7623:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1787823456.260836:0:7623:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787823456.260872:0:7623:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1787823456.260930:0:7623:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787823456.260958:0:7623:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1787823456.261494:0:7623:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1787823456.261506:0:7623:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787823456.261517:0:7623:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5d1142b8324815ba 00000020:01000004:0.0:1787823456.261524:0:7623:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1787823456.261548:0:7623:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.135@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787823456.261552:0:7623:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.135@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787823456.261558:0:7623:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1787823456.261592:0:7623:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1787823456.261597:0:7623:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.135@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1787823456.283550:0:7623:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.135@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787823456.283595:0:7623:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.135@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1787823456.283599:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787823456.283602:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787823456.283603:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787823456.283604:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787823456.283606:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787823456.283607:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787823456.283609:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787823456.283611:0:7623:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787823456.283612:0:7623:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787823456.283614:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787823456.283615:0:7623:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787823456.283620:0:7623:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1787823456.283622:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787823456.283624:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787823456.283625:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787823456.283626:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787823456.283627:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787823456.283629:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787823456.283630:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787823456.283631:0:7623:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787823456.283632:0:7623:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787823456.283633:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787823456.283634:0:7623:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787823456.283672:0:7623:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787823456.283690:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792eb04780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7623:1874668651820416:0@lo:253: 00000100:00100000:1.0:1787823456.283941:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823456.284074:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793b31fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787823456.284253:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651820416 00000100:00100000:2.0:1787823456.284261:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651820416 00000100:00100000:2.0:1787823456.284463:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787823456.284474:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+16:7623:x1874668651820416:12345-0@lo:253: 20000000:01000000:2.0:1787823456.284508:0:5832:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787823456.284513:0:5832:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1787823456.284519:0:5832:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1787823456.284523:0:5832:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1787823456.286458:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787823456.286698:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1787823456.287008:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1787823456.287131:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1787823456.287140:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1787823456.287247:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1787823456.289495:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1787823456.290529:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1787823456.290556:0:5832:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.135@tcp 20000000:01000000:2.0:1787823456.290558:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.135@tcp (null) (null) (null) 00000040:00080000:2.0:1787823456.290598:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1787823456.290606:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787823456.290653:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1787823456.290660:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.135@tcp (null) (null) 00000040:00080000:2.0:1787823456.290693:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1787823456.290702:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787823456.290954:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1787823456.291082:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1787823456.292531:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1787823456.292556:0:5832:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.135@tcp 20000000:01000000:2.0:1787823456.292559:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.135@tcp (null) (null) (null) 00000040:00080000:2.0:1787823456.292604:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1787823456.292612:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787823456.292641:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1787823456.292647:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.135@tcp (null) (null) 00000040:00080000:2.0:1787823456.292673:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1787823456.292681:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787823456.292738:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1787823456.294144:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1787823456.294247:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787823456.294251:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787823456.294255:0:5832:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787823456.294268:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787823456.294271:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787823456.294482:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787823456.294485:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787823456.295557:0:7625:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1787823456.295635:0:7625:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1787823456.295685:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1787823456.296262:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1787823456.296453:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1787823456.296538:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1787823456.296554:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787823456.296556:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787823456.297632:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1787823456.298271:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1787823456.298494:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1787823456.298571:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1787823456.298586:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787823456.298600:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787823456.301532:0:7627:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1787823456.301641:0:7627:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1787823456.301677:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1787823456.307223:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1787823456.307274:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1787823456.307491:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1787823456.307506:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787823456.307509:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787823456.308629:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1787823456.308991:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1787823456.309069:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1787823456.310050:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1787823456.310100:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1787823456.310135:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1787823456.310180:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1787823456.310184:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1787823456.310192:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787823456.310217:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e7900030200/0x5d1142b8324815c1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.310237:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e79013a3000/0x5d1142b832481512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b83248150b expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.310244:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7920eeaa00/0x5d1142b83248153c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832481535 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.310251:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7900030400/0x5d1142b832481566 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b83248155f expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.310258:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7900030800/0x5d1142b832481582 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b83248157b expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.310266:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7901677200/0x5d1142b8324815ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b8324815a5 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.310274:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e7900030200/0x5d1142b8324815c1 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.310590:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7901677200/0x5d1142b8324815ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d1142b8324815a5 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.310609:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7901677200/0x5d1142b8324815ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d1142b8324815a5 expref: 16 pid: 5831 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823456.310625:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef1680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1874668651820544:0@lo:104: 00000100:00100000:0.0:1787823456.310700:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787823456.310819:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7900030800/0x5d1142b832481582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d1142b83248157b expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.310828:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7900030800/0x5d1142b832481582 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d1142b83248157b expref: 16 pid: 5832 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823456.310838:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef0f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1874668651820672:0@lo:104: 00010000:00010000:0.0:1787823456.310862:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7900030400/0x5d1142b832481566 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d1142b83248155f expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.310869:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7900030400/0x5d1142b832481566 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d1142b83248155f expref: 16 pid: 5831 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823456.310876:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef3840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1874668651820800:0@lo:104: 00010000:00010000:0.0:1787823456.310897:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7920eeaa00/0x5d1142b83248153c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d1142b832481535 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.310905:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7920eeaa00/0x5d1142b83248153c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d1142b832481535 expref: 16 pid: 5831 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823456.310914:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef30c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1874668651820928:0@lo:104: 00010000:00010000:0.0:1787823456.310952:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e79013a3000/0x5d1142b832481512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d1142b83248150b expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.310961:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e79013a3000/0x5d1142b832481512 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d1142b83248150b expref: 16 pid: 5833 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823456.310969:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1874668651821056:0@lo:104: 00000100:00100000:0.0:1787823456.310985:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7918672b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787823456.311216:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787823456.311239:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823456.311262:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823456.311272:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823456.311281:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823456.311312:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651820544 00000100:00100000:1.0:1787823456.311320:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651820544 00000100:00100000:1.0:1787823456.311357:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651820672 00000100:00100000:1.0:1787823456.311360:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651820672 00000100:00100000:1.0:1787823456.311594:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651820800 00000100:00100000:1.0:1787823456.311598:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651820800 00000100:00100000:1.0:1787823456.311612:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651820928 00000100:00100000:1.0:1787823456.311614:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651820928 00000100:00100000:1.0:1787823456.311622:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651821056 00000100:00100000:1.0:1787823456.311624:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651821056 00000100:00100000:1.0:1787823456.311636:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787823456.311644:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903791850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+7:5832:x1874668651820544:12345-0@lo:104: 00010000:00010000:1.0:1787823456.311657:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b8324815a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b8324815ac expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823456.311726:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787823456.311732:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903791850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+7:5832:x1874668651820544:12345-0@lo:104: Request processed in 89us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823456.311740:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787823456.311802:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787823456.311809:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792eb07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+6:5832:x1874668651820672:12345-0@lo:104: 00010000:00010000:1.0:1787823456.311817:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff8e7900031000/0x5d1142b83248157b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b832481582 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823456.311869:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787823456.311874:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792eb07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+6:5832:x1874668651820672:12345-0@lo:104: Request processed in 67us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823456.311880:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787823456.311893:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787823456.311899:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792eb04f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+5:5832:x1874668651820800:12345-0@lo:104: 00010000:00010000:1.0:1787823456.311906:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff8e79013a2400/0x5d1142b83248155f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b832481566 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823456.311931:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787823456.311935:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792eb04f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+5:5832:x1874668651820800:12345-0@lo:104: Request processed in 38us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823456.311941:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787823456.311954:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787823456.311961:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792eb070c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+4:5832:x1874668651820928:12345-0@lo:104: 00010000:00010000:1.0:1787823456.311967:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff8e7900031800/0x5d1142b832481535 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b83248153c expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823456.311990:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787823456.311994:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792eb070c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+4:5832:x1874668651820928:12345-0@lo:104: Request processed in 36us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823456.312000:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787823456.312010:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787823456.312140:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792eb05e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+3:5832:x1874668651821056:12345-0@lo:104: 00010000:00010000:1.0:1787823456.312148:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff8e7901676c00/0x5d1142b83248150b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b832481512 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823456.312238:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1787823456.312243:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792eb05e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+3:5832:x1874668651821056:12345-0@lo:104: Request processed in 107us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823456.312249:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1787823456.312269:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787823456.312276:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b8324815a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b8324815ac expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823456.312283:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7901677e00 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:1.0:1787823456.312288:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b8324815a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d1142b8324815ac expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823456.312528:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787823456.312577:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b8324815a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d1142b8324815ac expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787823456.312587:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b8324815a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d1142b8324815ac expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787823456.312592:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787823456.312633:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b8324815a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b8324815ac expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823456.312639:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787823456.312655:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b8324815a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b8324815ac expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823456.312662:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b8324815a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b8324815ac expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823456.312688:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787823456.312691:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e79013a2400/0x5d1142b83248155f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b832481566 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823456.312697:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79013a2400 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:1.0:1787823456.312700:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e79013a2400/0x5d1142b83248155f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d1142b832481566 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823456.312706:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e79013a2400/0x5d1142b83248155f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d1142b832481566 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823456.312968:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef1680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1874668651820544:0@lo:104: 00000100:00100000:0.0:1787823456.312986:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef0f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1874668651820672:0@lo:104: 00000100:00100000:0.0:1787823456.312994:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef3840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1874668651820800:0@lo:104: 00000100:00100000:0.0:1787823456.313001:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef30c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1874668651820928:0@lo:104: 00000100:00100000:0.0:1787823456.313008:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1874668651821056:0@lo:104: 00010000:00010000:0.0:1787823456.313050:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e7900030200/0x5d1142b8324815c1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.313117:0:7629:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787823456.313124:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e7900031000/0x5d1142b83248157b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b832481582 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.313131:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7900031000 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:0.0:1787823456.313134:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e7900031000/0x5d1142b83248157b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d1142b832481582 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.313141:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e7900031000/0x5d1142b83248157b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d1142b832481582 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787823456.313147:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e7900031000/0x5d1142b83248157b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d1142b832481582 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787823456.313152:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787823456.313176:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e7900031000/0x5d1142b83248157b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832481582 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.313182:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787823456.313189:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e7900031000/0x5d1142b83248157b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832481582 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.313204:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e7900031000/0x5d1142b83248157b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832481582 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.313216:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787823456.313220:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e7901676c00/0x5d1142b83248150b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b832481512 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.313224:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7901676c00 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:0.0:1787823456.313227:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e7901676c00/0x5d1142b83248150b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d1142b832481512 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.313234:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e7901676c00/0x5d1142b83248150b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d1142b832481512 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787823456.313239:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e7901676c00/0x5d1142b83248150b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d1142b832481512 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787823456.313244:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787823456.313260:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e7901676c00/0x5d1142b83248150b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832481512 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.313265:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787823456.313280:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e7901676c00/0x5d1142b83248150b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832481512 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.313286:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e7901676c00/0x5d1142b83248150b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832481512 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.313313:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823456.313320:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823456.313322:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:1.0:1787823456.313696:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e79013a2400/0x5d1142b83248155f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d1142b832481566 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787823456.313701:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787823456.313871:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823456.313877:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e7900031800/0x5d1142b832481535 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b83248153c expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.313885:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7900031800 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:0.0:1787823456.313888:0:7629:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e7900031800/0x5d1142b832481535 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d1142b83248153c expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.313896:0:7629:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e7900031800/0x5d1142b832481535 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d1142b83248153c expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787823456.313902:0:7629:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e7900031800/0x5d1142b832481535 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d1142b83248153c expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787823456.313908:0:7629:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787823456.313926:0:7629:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e7900031800/0x5d1142b832481535 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b83248153c expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.313932:0:7629:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787823456.313939:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e7900031800/0x5d1142b832481535 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b83248153c expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.313946:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e7900031800/0x5d1142b832481535 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b83248153c expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.313956:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823456.313958:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823456.313959:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823456.313964:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823456.313974:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823456.314109:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e79013a2400/0x5d1142b83248155f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832481566 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823456.314116:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787823456.314121:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e79013a2400/0x5d1142b83248155f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832481566 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823456.314126:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e79013a2400/0x5d1142b83248155f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832481566 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823456.314143:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823456.314144:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823456.314146:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823456.314268:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792eb07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651821184:0@lo:103: 00000100:00100000:3.0:1787823456.314341:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823456.314501:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792eb07840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651821696:0@lo:103: 00000100:00100000:3.0:1787823456.314526:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823456.314556:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787823456.314562:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651821312:0@lo:103: 00000100:00100000:3.0:1787823456.314583:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823456.314611:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651821440:0@lo:103: 00000100:00100000:3.0:1787823456.314632:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823456.314643:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787823456.314648:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651821568:0@lo:103: 00000100:00100000:3.0:1787823456.314669:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823456.314693:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651821184 00000100:00100000:3.0:1787823456.314699:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651821184 00010000:00010000:3.0:1787823456.314731:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7901677200/0x5d1142b8324815ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b8324815a5 expref: 17 pid: 5831 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823456.314749:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651821696 00000100:00100000:3.0:1787823456.314751:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651821696 00010000:00010000:3.0:1787823456.314789:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7900030400/0x5d1142b832481566 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b83248155f expref: 18 pid: 5831 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823456.314800:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651821312 00000100:00100000:3.0:1787823456.314802:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651821312 00010000:00010000:3.0:1787823456.314824:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7900030800/0x5d1142b832481582 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b83248157b expref: 19 pid: 5832 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823456.314835:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651821440 00000100:00100000:3.0:1787823456.314837:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651821440 00010000:00010000:3.0:1787823456.314846:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e79013a3000/0x5d1142b832481512 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b83248150b expref: 20 pid: 5833 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823456.314854:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651821568 00000100:00100000:3.0:1787823456.314857:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651821568 00010000:00010000:3.0:1787823456.314865:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7920eeaa00/0x5d1142b83248153c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b832481535 expref: 21 pid: 5831 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823456.314877:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787823456.314884:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+21:3307:x1874668651821184:12345-0@lo:103: 00010000:00010000:3.0:1787823456.314897:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787823456.314901:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7901677200/0x5d1142b8324815ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b8324815a5 expref: 21 pid: 5831 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823456.314911:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7901677200/0x5d1142b8324815ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d1142b8324815a5 expref: 21 pid: 5831 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823456.314926:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7901677200/0x5d1142b8324815ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d1142b8324815a5 expref: 21 pid: 5831 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823456.314941:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787823456.314974:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+20:3307:x1874668651821184:12345-0@lo:103: Request processed in 89us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823456.314981:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787823456.314995:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787823456.315001:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3307:x1874668651821696:12345-0@lo:103: 00000100:00100000:1.0:1787823456.315120:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787823456.315134:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1787823456.315270:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787823456.315277:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7900030400/0x5d1142b832481566 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b83248155f expref: 19 pid: 5831 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823456.315287:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7900030400/0x5d1142b832481566 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d1142b83248155f expref: 19 pid: 5831 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823456.315366:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7900030400/0x5d1142b832481566 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d1142b83248155f expref: 19 pid: 5831 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823456.315442:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787823456.315469:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:3307:x1874668651821696:12345-0@lo:103: Request processed in 467us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823456.315475:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787823456.315487:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787823456.315494:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:3307:x1874668651821312:12345-0@lo:103: 00010000:00010000:3.0:1787823456.315501:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787823456.315505:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7900030800/0x5d1142b832481582 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b83248157b expref: 17 pid: 5832 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823456.315513:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7900030800/0x5d1142b832481582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d1142b83248157b expref: 17 pid: 5832 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823456.315524:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7900030800/0x5d1142b832481582 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d1142b83248157b expref: 17 pid: 5832 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823456.315532:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787823456.315552:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+16:3307:x1874668651821312:12345-0@lo:103: Request processed in 59us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823456.315557:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787823456.315577:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787823456.315582:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+15:3305:x1874668651821440:12345-0@lo:103: 00010000:00010000:3.0:1787823456.315590:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787823456.315595:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e79013a3000/0x5d1142b832481512 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b83248150b expref: 15 pid: 5833 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823456.315603:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e79013a3000/0x5d1142b832481512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d1142b83248150b expref: 15 pid: 5833 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823456.315613:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e79013a3000/0x5d1142b832481512 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d1142b83248150b expref: 15 pid: 5833 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823456.315623:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787823456.315723:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787823456.315735:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787823456.315742:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:3305:x1874668651821568:12345-0@lo:103: 00010000:00010000:0.0:1787823456.315750:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787823456.315754:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7920eeaa00/0x5d1142b83248153c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b832481535 expref: 14 pid: 5831 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.315782:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7920eeaa00/0x5d1142b83248153c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d1142b832481535 expref: 14 pid: 5831 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.315792:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7920eeaa00/0x5d1142b83248153c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d1142b832481535 expref: 14 pid: 5831 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.315802:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e7900030200/0x5d1142b8324815c1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.315810:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7900030200/0x5d1142b8324815c1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.315823:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7900030200/0x5d1142b8324815c1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.315830:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7900030200/0x5d1142b8324815c1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.315838:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e7900030200/0x5d1142b8324815c1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.315844:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e7900030200/0x5d1142b8324815c1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.315863:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7900030200 already unused, calling callback (ffffffffc1649440) 00010000:00010000:0.0:1787823456.315867:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e7900030200/0x5d1142b8324815c1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.315875:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e7900030200/0x5d1142b8324815c1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.315889:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e7900030200/0x5d1142b8324815c1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.315899:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787823456.315955:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:3305:x1874668651821440:12345-0@lo:103: Request processed in 371us (1321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823456.315962:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787823456.315995:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651821312:0@lo:103: 00000100:00100000:3.0:1787823456.316005:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792eb07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651821184:0@lo:103: 00000100:00100000:3.0:1787823456.316023:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792eb07840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651821696:0@lo:103: 00010000:00010000:2.0:1787823456.316527:0:5832:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e7900030200/0x5d1142b8324815c1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823456.316536:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e7900030200/0x5d1142b8324815c1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823456.316543:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7900030200/0x5d1142b8324815c1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787823456.316559:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787823456.317057:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:3305:x1874668651821568:12345-0@lo:103: Request processed in 1313us (2383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823456.317066:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787823456.317792:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651821440:0@lo:103: 00000100:00100000:1.0:1787823456.317820:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651821568:0@lo:103: 00000100:00100000:2.0:1787823456.376144:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+11:7623:x1874668651820416:12345-0@lo:253: Request processed in 91663us (92195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823456.376180:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787823456.376364:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792eb04780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7623:1874668651820416:0@lo:253: 10000000:01000000:1.0:1787823456.376542:0:7623:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787823456.376546:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787823456.376548:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787823456.376549:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787823456.376550:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1787823456.376552:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787823456.376553:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787823456.376555:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787823456.376557:0:7623:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787823456.376559:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787823456.376560:0:7623:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787823456.376580:0:7623:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e7903710800 from lustre-OST0001 10000000:01000000:1.0:1787823456.376607:0:7623:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787823456.376610:0:7623:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787823456.376618:0:7623:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e7906ef0000 local copy 10000000:01000000:1.0:1787823456.376623:0:7623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787823456.376660:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b8324815c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823456.376672:0:7623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b8324815c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823456.376681:0:7623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b8324815c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823456.376699:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792eb04780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7623:1874668651821824:0@lo:101: 00000100:00100000:1.0:1787823456.376840:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823456.376899:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793b31f780 going to sleep for 11 seconds 00000100:00100000:2.0:1787823456.376999:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651821824 00000100:00100000:2.0:1787823456.377005:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651821824 00000100:00100000:2.0:1787823456.377056:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787823456.377066:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+11:7623:x1874668651821824:12345-0@lo:101: 00010000:00010000:2.0:1787823456.377079:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823456.377093:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e79013a3800/0x5d1142b8324815cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b8324815c8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823456.377118:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e79013a3800/0x5d1142b8324815cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b8324815c8 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823456.377128:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e79013a3800/0x5d1142b8324815cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b8324815c8 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823456.377136:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79013a3800, rc 0) 00000100:00100000:2.0:1787823456.377482:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:7623:x1874668651821824:12345-0@lo:101: Request processed in 416us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823456.377491:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787823456.377612:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792eb04780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7623:1874668651821824:0@lo:101: 00010000:00010000:0.0:1787823456.377626:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b8324815c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5d1142b8324815cf expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.377636:0:7623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b8324815c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5d1142b8324815cf expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823456.377880:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7623:1874668651821952:0@lo:501: 00000100:00100000:0.0:1787823456.377915:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823456.377986:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7918672540 going to sleep for 11 seconds 00000100:00100000:2.0:1787823456.378030:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651821952 00000100:00100000:2.0:1787823456.378035:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651821952 00000100:00100000:2.0:1787823456.378109:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787823456.378118:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:7623:x1874668651821952:12345-0@lo:501: 00000100:00100000:2.0:1787823456.378359:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:7623:x1874668651821952:12345-0@lo:501: Request processed in 242us (442us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787823456.378518:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7623:1874668651821952:0@lo:501: 10000000:01000000:0.0:1787823456.378535:0:7623:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.135@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787823456.378560:0:7623:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.135@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787823456.378572:0:7623:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b8324815c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5d1142b8324815cf expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.378582:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b8324815c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5d1142b8324815cf expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.378588:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b8324815c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5d1142b8324815cf expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.378615:0:7623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787823456.378636:0:7623:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e7903710800 10000000:01000000:0.0:1787823456.378641:0:7623:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787823456.378646:0:7623:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787823456.378649:0:7623:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787823456.378653:0:7623:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787823456.378656:0:7623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787823456.378677:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7900031800/0x5d1142b8324815d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.378684:0:7623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e7900031800/0x5d1142b8324815d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.378692:0:7623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e7900031800/0x5d1142b8324815d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823456.378703:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7623:1874668651822080:0@lo:101: 00000100:00100000:0.0:1787823456.378730:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787823456.378782:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787823456.378789:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b8324815c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x5d1142b8324815cf expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823456.378796:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7901677e00 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:3.0:1787823456.378799:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b8324815c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x5d1142b8324815cf expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823456.378808:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b8324815c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x5d1142b8324815cf expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787823456.378822:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b8324815c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x5d1142b8324815cf expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787823456.378828:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787823456.378847:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b8324815c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5d1142b8324815cf expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823456.378853:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787823456.378871:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b8324815c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5d1142b8324815cf expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823456.378878:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b8324815c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5d1142b8324815cf expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823456.378891:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823456.378893:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823456.378894:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823456.378905:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3308:1874668651822208:0@lo:103: 00000100:00100000:3.0:1787823456.378934:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823456.378978:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651822208 00000100:00100000:3.0:1787823456.378982:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651822208 00000100:00100000:3.0:1787823456.379028:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787823456.379036:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:3308:x1874668651822208:12345-0@lo:103: 00010000:00010000:3.0:1787823456.379046:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787823456.379059:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e79013a3800/0x5d1142b8324815cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d1142b8324815c8 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823456.379074:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787823456.379108:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:3308:x1874668651822208:12345-0@lo:103: Request processed in 73us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823456.379114:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787823456.379145:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3308:1874668651822208:0@lo:103: 00000100:00100000:2.0:1787823456.379269:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787823456.379625:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7918672e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787823456.379679:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651822080 00000100:00100000:2.0:1787823456.379683:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651822080 00000100:00100000:2.0:1787823456.379707:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787823456.379713:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+11:7623:x1874668651822080:12345-0@lo:101: 00010000:00010000:2.0:1787823456.379724:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823456.379747:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e79013a3000/0x5d1142b8324815dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b8324815d6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823456.379794:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e79013a3000/0x5d1142b8324815dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b8324815d6 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823456.379805:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e79013a3000/0x5d1142b8324815dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b8324815d6 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823456.379812:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79013a3000, rc 0) 00000100:00100000:2.0:1787823456.379844:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:7623:x1874668651822080:12345-0@lo:101: Request processed in 131us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823456.379850:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787823456.379966:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7623:1874668651822080:0@lo:101: 00010000:00010000:0.0:1787823456.379979:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e7900031800/0x5d1142b8324815d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324815dd expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.379996:0:7623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e7900031800/0x5d1142b8324815d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b8324815dd expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823456.380091:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7623:1874668651822336:0@lo:501: 00000100:00100000:0.0:1787823456.380119:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823456.380147:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7918672e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787823456.380278:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651822336 00000100:00100000:3.0:1787823456.380282:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651822336 00000100:00100000:3.0:1787823456.380318:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787823456.380326:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:7623:x1874668651822336:12345-0@lo:501: 00000100:00100000:3.0:1787823456.380708:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:7623:x1874668651822336:12345-0@lo:501: Request processed in 382us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823456.380715:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787823456.380865:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7623:1874668651822336:0@lo:501: 00000100:00100000:0.0:1787823456.380896:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7623:1874668651822464:0@lo:503: 00000100:00100000:0.0:1787823456.380937:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823456.380959:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7918672e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787823456.381039:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651822464 00000100:00100000:3.0:1787823456.381044:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651822464 00000100:00100000:3.0:1787823456.381063:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787823456.381069:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:7623:x1874668651822464:12345-0@lo:503: 00000100:00100000:3.0:1787823456.381223:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:7623:x1874668651822464:12345-0@lo:503: Request processed in 153us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823456.381230:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787823456.381524:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7623:1874668651822464:0@lo:503: 00000040:00080000:0.0:1787823456.381836:0:7623:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787823456.381907:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7623:1874668651822592:0@lo:502: 00000100:00100000:0.0:1787823456.381950:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823456.381972:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7918672e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787823456.382138:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651822592 00000100:00100000:3.0:1787823456.382142:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651822592 00000100:00100000:3.0:1787823456.382176:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787823456.382183:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:7623:x1874668651822592:12345-0@lo:502: 00000100:00100000:3.0:1787823456.382341:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:7623:x1874668651822592:12345-0@lo:502: Request processed in 157us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823456.382348:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787823456.382721:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7623:1874668651822592:0@lo:502: 00000040:00080000:0.0:1787823456.383150:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787823456.383614:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1787823456.383654:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1787823456.383722:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1787823456.383942:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1787823456.383978:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1787823456.384023:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7623:1874668651822720:0@lo:502: 00000100:00100000:0.0:1787823456.384092:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823456.384184:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7918672e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787823456.384482:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651822720 00000100:00100000:1.0:1787823456.384490:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651822720 00000100:00100000:3.0:1787823456.384553:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787823456.384564:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:7623:x1874668651822720:12345-0@lo:502: 00000100:00100000:3.0:1787823456.384828:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:7623:x1874668651822720:12345-0@lo:502: Request processed in 263us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823456.384836:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787823456.385049:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7623:1874668651822720:0@lo:502: 00000040:00080000:0.0:1787823456.385173:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787823456.385185:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1787823456.386585:0:7634:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787823456.386595:0:7634:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1787823456.386602:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787823456.386604:0:7634:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787823456.386610:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787823456.386626:0:7634:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8e7906f4cd70) 00000020:00000080:2.0:1787823456.386648:0:7634:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787823456.386653:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787823456.386709:0:7634:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e7903710800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787823456.386717:0:7634:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787823456.386723:0:7634:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5d1142b8324815eb 00010000:00010000:2.0:1787823456.390746:0:7634:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1787823456.395692:0:7634:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1787823456.401279:0:7634:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787823456.402036:0:7634:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1787823456.414659:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1787823456.415255:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1787823456.421516:0:7634:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787823456.421530:0:7634:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787823456.421537:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787823456.421540:0:7634:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787823456.421543:0:7634:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787823456.421547:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787823456.421548:0:7634:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787823456.421551:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787823456.421553:0:7634:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787823456.421609:0:7634:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787823456.421613:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787823456.421614:0:7634:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787823456.421618:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787823456.421994:0:7623:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1787823456.422037:0:7623:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787823456.422059:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7900031800/0x5d1142b8324815d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324815dd expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823456.422071:0:7623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e7900031800/0x5d1142b8324815d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324815dd expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787823456.422080:0:7623:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e7903710800 from 1 10000000:01000000:1.0:1787823456.422083:0:7623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787823456.422120:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7901676e00/0x5d1142b8324815f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823456.422128:0:7623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e7901676e00/0x5d1142b8324815f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823456.422140:0:7623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e7901676e00/0x5d1142b8324815f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823456.422175:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792eb061c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7623:1874668651822848:0@lo:101: 00000100:00100000:1.0:1787823456.422250:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823456.422289:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793b31f840 going to sleep for 11 seconds 00000100:00100000:2.0:1787823456.425914:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651822848 00000100:00100000:2.0:1787823456.425933:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651822848 00000100:00100000:2.0:1787823456.425989:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787823456.425999:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:7623:x1874668651822848:12345-0@lo:101: 00010000:00010000:2.0:1787823456.426030:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823456.426048:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e79013a2400/0x5d1142b8324815f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b8324815f2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823456.426077:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e79013a2400/0x5d1142b8324815f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b8324815f2 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823456.426088:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e79013a2400/0x5d1142b8324815f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b8324815f2 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823456.426096:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79013a2400, rc 0) 00000100:00100000:2.0:1787823456.426180:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:7623:x1874668651822848:12345-0@lo:101: Request processed in 182us (3930us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823456.426198:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787823456.427557:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792eb061c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7623:1874668651822848:0@lo:101: 00010000:00010000:1.0:1787823456.427585:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e7901676e00/0x5d1142b8324815f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324815f9 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823456.427596:0:7623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e7901676e00/0x5d1142b8324815f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b8324815f9 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823456.427751:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792eb061c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7623:1874668651822976:0@lo:501: 00000100:00100000:1.0:1787823456.427818:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823456.427855:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651822976 00000100:00100000:1.0:1787823456.427860:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651822976 00000100:00100000:0.0:1787823456.428873:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793b31f840 going to sleep for 11 seconds 00000100:00100000:1.0:1787823456.430600:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787823456.430622:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:7623:x1874668651822976:12345-0@lo:501: 00000100:00100000:1.0:1787823456.434033:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:7623:x1874668651822976:12345-0@lo:501: Request processed in 3400us (6194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823456.434048:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787823456.439645:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792eb061c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7623:1874668651822976:0@lo:501: 00000100:00100000:1.0:1787823456.439826:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792eb061c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7623:1874668651823104:0@lo:503: 00000100:00100000:1.0:1787823456.439899:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823456.439937:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793b31f480 going to sleep for 11 seconds 00000100:00100000:0.0:1787823456.440139:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651823104 00000100:00100000:0.0:1787823456.440147:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651823104 00000100:00100000:0.0:1787823456.440204:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787823456.440214:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:7623:x1874668651823104:12345-0@lo:503: 00000100:00100000:0.0:1787823456.440608:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:7623:x1874668651823104:12345-0@lo:503: Request processed in 394us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823456.440616:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787823456.440974:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792eb061c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7623:1874668651823104:0@lo:503: 00000040:00080000:1.0:1787823456.441275:0:7623:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787823456.441600:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792eb061c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7623:1874668651823232:0@lo:502: 00000100:00100000:1.0:1787823456.441652:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823456.441692:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793b31f480 going to sleep for 11 seconds 00000100:00100000:2.0:1787823456.442634:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651823232 00000100:00100000:2.0:1787823456.442641:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651823232 00000100:00100000:2.0:1787823456.442689:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787823456.442699:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:7623:x1874668651823232:12345-0@lo:502: 00000100:00100000:2.0:1787823456.442995:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:7623:x1874668651823232:12345-0@lo:502: Request processed in 297us (1342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823456.443003:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787823456.443338:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792eb061c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7623:1874668651823232:0@lo:502: 00000040:00080000:1.0:1787823456.443908:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787823456.443968:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787823456.444127:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792eb061c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7623:1874668651823360:0@lo:502: 00000100:00100000:1.0:1787823456.444186:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823456.444223:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793b31f480 going to sleep for 11 seconds 00000100:00100000:2.0:1787823456.446333:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651823360 00000100:00100000:2.0:1787823456.446355:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651823360 00000100:00100000:2.0:1787823456.446623:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787823456.446634:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:7623:x1874668651823360:12345-0@lo:502: 00000100:00100000:2.0:1787823456.446941:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:7623:x1874668651823360:12345-0@lo:502: Request processed in 308us (2754us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823456.446949:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787823456.449009:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792eb061c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7623:1874668651823360:0@lo:502: 00000040:00080000:1.0:1787823456.449229:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787823456.449244:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787823456.454647:0:7638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787823456.454666:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787823456.454668:0:7638:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787823456.454676:0:7638:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e7903710800 00000020:00000080:0.0:1787823456.454679:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787823456.454702:0:7638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787823456.454706:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787823456.454707:0:7638:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787823456.454711:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787823456.463581:0:7623:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787823456.463637:0:7623:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787823456.463701:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7901676e00/0x5d1142b8324815f2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324815f9 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823456.463716:0:7623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e7901676e00/0x5d1142b8324815f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324815f9 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787823456.466184:0:7623:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787823456.466195:0:7623:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e7903710800 10000000:01000000:3.0:1787823456.466198:0:7623:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e7903710800 10000000:01000000:3.0:1787823456.466202:0:7623:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787823456.466210:0:7623:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e7903710800 from 1 10000000:01000000:3.0:1787823456.466213:0:7623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787823456.466255:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7920eea600/0x5d1142b832481600 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823456.466267:0:7623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e7920eea600/0x5d1142b832481600 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823456.466277:0:7623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e7920eea600/0x5d1142b832481600 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823456.466315:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec4f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7623:1874668651823488:0@lo:101: 00000100:00100000:3.0:1787823456.466606:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823456.466658:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79052756c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787823456.466740:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651823488 00000100:00100000:0.0:1787823456.466749:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651823488 00000100:00100000:0.0:1787823456.466832:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787823456.466842:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:7623:x1874668651823488:12345-0@lo:101: 00010000:00010000:0.0:1787823456.466855:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823456.466868:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7900031000/0x5d1142b832481607 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b832481600 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.466902:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7900031000/0x5d1142b832481607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b832481600 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.466913:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7900031000/0x5d1142b832481607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832481600 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.466922:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7900031000, rc 0) 00000100:00100000:0.0:1787823456.466962:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:7623:x1874668651823488:12345-0@lo:101: Request processed in 122us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823456.466968:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787823456.467085:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec4f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7623:1874668651823488:0@lo:101: 00010000:00010000:1.0:1787823456.467102:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e7920eea600/0x5d1142b832481600 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481607 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823456.467111:0:7623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e7920eea600/0x5d1142b832481600 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b832481607 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823456.467209:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792eb061c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7623:1874668651823616:0@lo:501: 00000100:00100000:1.0:1787823456.467239:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823456.467269:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793b31f480 going to sleep for 11 seconds 00000100:00100000:3.0:1787823456.467715:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651823616 00000100:00100000:3.0:1787823456.467720:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651823616 00000100:00100000:3.0:1787823456.467778:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787823456.467785:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:7623:x1874668651823616:12345-0@lo:501: 00000100:00100000:3.0:1787823456.468053:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:7623:x1874668651823616:12345-0@lo:501: Request processed in 268us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823456.468060:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787823456.470095:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792eb061c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7623:1874668651823616:0@lo:501: 00000100:00100000:1.0:1787823456.470165:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792eb061c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7623:1874668651823744:0@lo:503: 00000100:00100000:1.0:1787823456.470232:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823456.470260:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793b31f480 going to sleep for 11 seconds 00000100:00100000:3.0:1787823456.470670:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651823744 00000100:00100000:3.0:1787823456.470677:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651823744 00000100:00100000:3.0:1787823456.470726:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787823456.470746:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:7623:x1874668651823744:12345-0@lo:503: 00000100:00100000:3.0:1787823456.470979:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:7623:x1874668651823744:12345-0@lo:503: Request processed in 244us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823456.470987:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787823456.471747:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792eb061c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7623:1874668651823744:0@lo:503: 00000040:00080000:1.0:1787823456.472150:0:7623:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787823456.472235:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792eb061c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7623:1874668651823872:0@lo:502: 00000100:00100000:1.0:1787823456.472283:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823456.472321:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793b31f480 going to sleep for 11 seconds 00000100:00100000:0.0:1787823456.472684:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651823872 00000100:00100000:0.0:1787823456.472691:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651823872 00000100:00100000:0.0:1787823456.472734:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787823456.472742:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:7623:x1874668651823872:12345-0@lo:502: 00000100:00100000:0.0:1787823456.472980:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:7623:x1874668651823872:12345-0@lo:502: Request processed in 237us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823456.472987:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787823456.474110:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792eb061c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7623:1874668651823872:0@lo:502: 00000040:00080000:1.0:1787823456.474482:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787823456.474540:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787823456.474575:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787823456.474631:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787823456.474673:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787823456.474720:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787823456.474791:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787823456.474830:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787823456.474877:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787823456.474914:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787823456.474947:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787823456.474994:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787823456.475047:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787823456.475080:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787823456.475140:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787823456.475187:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787823456.475221:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787823456.475275:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787823456.475311:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787823456.475344:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787823456.475392:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787823456.475428:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787823456.475460:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787823456.475507:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787823456.475544:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1787823456.475578:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1787823456.475624:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1787823456.475659:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1787823456.475693:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1787823456.475741:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1787823456.475802:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1787823456.475857:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1787823456.475892:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1787823456.475941:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1787823456.475978:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1787823456.476045:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1787823456.476087:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1787823456.476140:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792eb061c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7623:1874668651824000:0@lo:502: 00000100:00100000:1.0:1787823456.476225:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823456.476282:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793b31f480 going to sleep for 11 seconds 00000100:00100000:2.0:1787823456.476660:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651824000 00000100:00100000:2.0:1787823456.476668:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651824000 00000100:00100000:2.0:1787823456.476721:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787823456.476729:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:7623:x1874668651824000:12345-0@lo:502: 00000100:00100000:2.0:1787823456.476988:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:7623:x1874668651824000:12345-0@lo:502: Request processed in 259us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823456.476996:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787823456.477108:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792eb061c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7623:1874668651824000:0@lo:502: 00000040:00080000:3.0:1787823456.477195:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1787823456.477209:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1787823456.478225:0:7639:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787823456.478242:0:7639:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8e79037099d0) 00000020:00000080:3.0:1787823456.478265:0:7639:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1787823456.478374:0:7639:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e7903710800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787823456.478378:0:7639:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e7903710800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787823456.478381:0:7639:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e7903710800 3 00010000:00080000:3.0:1787823456.478409:0:7639:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e793a421800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.135@tcp at head 00010000:00010000:3.0:1787823456.480050:0:7639:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1787823456.480254:0:7639:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787823456.480290:0:7639:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787823456.480303:0:7639:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5d1142b832481615 00000100:00080000:3.0:1787823456.480321:0:7639:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787823456.480326:0:7639:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e793a421800 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:3.0:1787823456.480361:0:7639:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e792ec4f0c0 x1874668651824128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787823456.480383:0:7639:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787823456.480832:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec4f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1874668651824128:0@lo:38: 00000100:00100000:2.0:1787823456.480903:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823456.480964:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651824128 00000100:00100000:2.0:1787823456.480971:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651824128 00000100:00100000:2.0:1787823456.481029:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787823456.481036:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ac87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3304:x1874668651824128:12345-0@lo:38: 00010000:00080000:2.0:1787823456.481060:0:5839:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 197 last 0 00000020:00000080:2.0:1787823456.481092:0:5839:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5d1142b83248161c 00000004:00100000:2.0:1787823456.481107:0:5839:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787823456.481144:0:5839:0:(import.c:65:import_set_state_nolock()) ffff8e7918296000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787823456.481194:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ac87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874668651824128:12345-0@lo:38: Request processed in 158us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823456.481201:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787823456.481244:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e792ec4f0c0 x1874668651824128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787823466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823456.481253:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787823456.481259:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787823456.481265:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787823456.481269:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787823456.481271:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8e793a421800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787823456.481275:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec4f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1874668651824128:0@lo:38: 00000100:00100000:1.0:1787823456.485638:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792eb06940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874668651824384:0@lo:400: 00000100:00100000:1.0:1787823456.485723:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823456.485786:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787823456.485792:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792eb05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874668651824256:0@lo:400: 00000100:00100000:1.0:1787823456.485816:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1787823456.485994:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:0.0:1787823456.486158:0:7640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef0f00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7640:1874668651824640:0@lo:901: 00000100:00100000:0.0:1787823456.486196:0:7640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823456.486219:0:7640:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e791008ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1787823456.486292:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651824384 00000100:00100000:2.0:1787823456.486299:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651824384 00000100:00100000:2.0:1787823456.487673:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651824256 00000100:00100000:2.0:1787823456.487683:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651824256 00000100:00100000:2.0:1787823456.487718:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787823456.487728:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792eb061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874668651824384:12345-0@lo:400: 00000100:00100000:2.0:1787823456.487825:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792eb061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874668651824384:12345-0@lo:400: Request processed in 99us (2102us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823456.487833:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787823456.487850:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787823456.487869:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792eb04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874668651824256:12345-0@lo:400: 00000100:00100000:2.0:1787823456.487898:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792eb04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874668651824256:12345-0@lo:400: Request processed in 30us (2082us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823456.487903:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787823456.489286:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792eb043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651824512:0@lo:400: 00000100:00100000:3.0:1787823456.489365:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823456.489438:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651824512 00000100:00100000:3.0:1787823456.489444:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651824512 00000100:00100000:3.0:1787823456.489480:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787823456.489487:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651824512:12345-0@lo:400: 00000100:00100000:3.0:1787823456.489529:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651824512:12345-0@lo:400: Request processed in 42us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823456.489536:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787823456.489571:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e792eb043c0 x1874668651824512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823456.489584:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792eb043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651824512:0@lo:400: 00000020:01000000:0.0:1787823456.493668:0:7623:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1787823456.493713:0:7623:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787823456.493733:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7920eea600/0x5d1142b832481600 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481607 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.493747:0:7623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e7920eea600/0x5d1142b832481600 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481607 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787823456.493842:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787823456.493844:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787823456.493846:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787823456.493847:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787823456.493849:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787823456.493850:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787823456.493851:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787823456.493853:0:7623:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787823456.493854:0:7623:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787823456.493856:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787823456.493857:0:7623:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787823456.493861:0:7623:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1787823456.493863:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787823456.493864:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787823456.493865:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787823456.493867:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787823456.493867:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787823456.493868:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787823456.493869:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787823456.493870:0:7623:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787823456.493871:0:7623:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787823456.493872:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787823456.493873:0:7623:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787823456.493917:0:7623:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787823456.493938:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7623:1874668651824768:0@lo:253: 00000100:00100000:0.0:1787823456.494028:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787823456.494299:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e792eb05a40 x1874668651824256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787823472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823456.494314:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792eb05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874668651824256:0@lo:400: 00010000:00080000:2.0:1787823456.494327:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e792eb06940 x1874668651824384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787823472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823456.494336:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792eb06940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874668651824384:0@lo:400: 00000100:00100000:3.0:1787823456.498618:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651824768 00000100:00100000:3.0:1787823456.498632:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651824768 00000100:00100000:3.0:1787823456.498693:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787823456.498703:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:7623:x1874668651824768:12345-0@lo:253: 20000000:01000000:3.0:1787823456.498736:0:5833:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787823456.498752:0:5833:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787823456.504459:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651824640 00000100:00100000:1.0:1787823456.504472:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651824640 00000100:00100000:1.0:1787823456.504553:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787823456.504564:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790aef1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:7640:x1874668651824640:12345-0@lo:901: 00000100:00100000:1.0:1787823456.505043:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790aef1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:7640:x1874668651824640:12345-0@lo:901: Request processed in 479us (18844us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823456.505052:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787823456.505106:0:7640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e790aef0f00 x1874668651824640/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787823472 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787823456.505121:0:7640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef0f00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7640:1874668651824640:0@lo:901: 00000100:00080000:3.0:1787823456.505840:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787823456.511108:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e791008ecc0 going to sleep for 11 seconds 00010000:00010000:1.0:1787823456.511253:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:0.0:1787823456.576307:0:5833:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787823456.576334:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787823456.578745:0:5854:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787823456.578777:0:5854:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787823456.578800:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e7920eebe00/0x5d1142b832481623 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823456.578832:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7920eea200/0x5d1142b832481574 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b83248156d expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823456.578840:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e7920eebe00/0x5d1142b832481623 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823456.578885:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7920eea200/0x5d1142b832481574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d1142b83248156d expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823456.578898:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7920eea200/0x5d1142b832481574 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d1142b83248156d expref: 14 pid: 5833 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823456.578913:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec4fc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1874668651824896:0@lo:104: 00000100:00100000:3.0:1787823456.578983:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823456.579119:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651824896 00000100:00100000:0.0:1787823456.579128:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651824896 00000100:00100000:0.0:1787823456.579195:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787823456.579205:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+3:5854:x1874668651824896:12345-0@lo:104: 00010000:00010000:0.0:1787823456.579218:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff8e7900031400/0x5d1142b83248156d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b832481574 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.579277:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787823456.579283:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+3:5854:x1874668651824896:12345-0@lo:104: Request processed in 81us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823456.579291:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1787823456.579312:0:7630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787823456.579318:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e7900031400/0x5d1142b83248156d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b832481574 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.579325:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7900031400 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:0.0:1787823456.579329:0:7630:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e7900031400/0x5d1142b83248156d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d1142b832481574 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.579337:0:7630:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e7900031400/0x5d1142b83248156d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d1142b832481574 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787823456.579542:0:7630:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e7900031400/0x5d1142b83248156d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d1142b832481574 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787823456.579549:0:7630:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787823456.579587:0:7630:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e7900031400/0x5d1142b83248156d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832481574 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.579593:0:7630:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787823456.579612:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e7900031400/0x5d1142b83248156d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832481574 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.579620:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e7900031400/0x5d1142b83248156d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832481574 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823456.579649:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823456.579651:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823456.579653:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823456.579796:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7903798840 going to sleep for 11 seconds 00000100:00100000:3.0:1787823456.579820:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec4fc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1874668651824896:0@lo:104: 00010000:00010000:3.0:1787823456.579840:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e7920eebe00/0x5d1142b832481623 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823456.579862:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3308:1874668651825024:0@lo:103: 00000100:00100000:3.0:1787823456.579896:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823456.585416:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651825024 00000100:00100000:2.0:1787823456.585430:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651825024 00010000:00010000:2.0:1787823456.585479:0:7631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7920eea200/0x5d1142b832481574 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b83248156d expref: 15 pid: 5833 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823456.585521:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787823456.585530:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909a20050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+15:3308:x1874668651825024:12345-0@lo:103: 00010000:00010000:2.0:1787823456.585547:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787823456.585551:0:7631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7920eea200/0x5d1142b832481574 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b83248156d expref: 15 pid: 5833 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823456.585564:0:7631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7920eea200/0x5d1142b832481574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d1142b83248156d expref: 15 pid: 5833 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823456.585580:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7920eea200/0x5d1142b832481574 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d1142b83248156d expref: 15 pid: 5833 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823456.585615:0:7631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e7920eebe00/0x5d1142b832481623 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823456.585623:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7920eebe00/0x5d1142b832481623 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787823456.585638:0:7631:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006883159s 00010000:00010000:2.0:1787823456.585643:0:7631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7920eebe00/0x5d1142b832481623 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823456.585649:0:7631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7920eebe00/0x5d1142b832481623 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823456.585656:0:7631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e7920eebe00/0x5d1142b832481623 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823456.585663:0:7631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e7920eebe00/0x5d1142b832481623 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823456.585670:0:7631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eebe00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:2.0:1787823456.585674:0:7631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e7920eebe00/0x5d1142b832481623 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823456.585681:0:7631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e7920eebe00/0x5d1142b832481623 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823456.585702:0:7631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e7920eebe00/0x5d1142b832481623 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823456.585712:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787823456.585807:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909a20050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:3308:x1874668651825024:12345-0@lo:103: Request processed in 277us (5910us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823456.585815:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1787823456.589553:0:5854:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e7920eebe00/0x5d1142b832481623 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823456.589573:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e7920eebe00/0x5d1142b832481623 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823456.589580:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7920eebe00/0x5d1142b832481623 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823456.589913:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3308:1874668651825024:0@lo:103: 00000100:00100000:3.0:1787823456.595941:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:7623:x1874668651824768:12345-0@lo:253: Request processed in 97230us (101918us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823456.595955:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787823456.606680:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7623:1874668651824768:0@lo:253: 10000000:01000000:0.0:1787823456.606703:0:7623:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787823456.606707:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787823456.606708:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787823456.606710:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787823456.606711:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787823456.606712:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787823456.606713:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787823456.606715:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787823456.606728:0:7623:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787823456.606730:0:7623:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787823456.606732:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787823456.606733:0:7623:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787823456.606748:0:7623:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787823456.615733:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787823456.615964:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787823456.616212:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787823456.616388:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787823456.616597:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787823456.616876:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787823456.623681:0:7623:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1787823456.976279:0:7623:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787823456.976289:0:7623:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787823456.976333:0:7623:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787823456.976407:0:7623:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.135@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787823456.976444:0:7623:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787823456.976475:0:7623:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1787823457.514168:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823458.538956:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823459.563779:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823460.585959:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787823460.845366:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651825152:0@lo:13: 00000100:00100000:2.0:1787823460.845445:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823460.845696:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651825152 00000100:00100000:0.0:1787823460.845703:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651825152 00000100:00100000:0.0:1787823460.845787:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787823460.845797:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ac84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651825152:12345-0@lo:13: 00002000:00000024:0.0:1787823460.845835:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787823460.845883:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ac84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651825152:12345-0@lo:13: Request processed in 88us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823460.845890:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787823460.845931:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e790aef0780 x1874668651825152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823476 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823460.845950:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651825152:0@lo:13: 00000100:00080000:2.0:1787823460.846033:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787823461.610676:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823461.869294:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792eb04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651825664:0@lo:400: 00000100:00100000:1.0:1787823461.869368:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823461.869422:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787823461.869429:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792eb07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651825280:0@lo:400: 00000100:00100000:1.0:1787823461.869456:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823461.869478:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792eb04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874668651825792:0@lo:400: 00000100:00100000:1.0:1787823461.869502:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823461.869526:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792eb05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874668651825408:0@lo:400: 00000100:00100000:1.0:1787823461.869547:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823461.869565:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787823461.869569:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792eb06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874668651825536:0@lo:400: 00000100:00100000:1.0:1787823461.869588:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823461.869617:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651825664 00000100:00100000:1.0:1787823461.869623:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651825664 00000100:00100000:1.0:1787823461.869664:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787823461.869673:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792eb06940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651825664:12345-0@lo:400: 00000100:00100000:2.0:1787823461.872419:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651825792 00000100:00100000:2.0:1787823461.872433:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651825792 00000100:00100000:2.0:1787823461.872488:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651825408 00000100:00100000:2.0:1787823461.872492:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651825408 00000100:00100000:2.0:1787823461.872505:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651825536 00000100:00100000:2.0:1787823461.872508:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651825536 00000100:00100000:2.0:1787823461.872526:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787823461.872568:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792eb05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874668651825792:12345-0@lo:400: 00000100:00100000:2.0:1787823461.872662:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792eb05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874668651825792:12345-0@lo:400: Request processed in 127us (3157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823461.872669:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787823461.872702:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787823461.872708:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792eb043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874668651825408:12345-0@lo:400: 00000100:00100000:0.0:1787823461.873487:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787823461.873501:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787823461.873520:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651825280 00000100:00100000:0.0:1787823461.873525:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651825280 00000100:00100000:0.0:1787823461.873558:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787823461.873566:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:3305:x1874668651825280:12345-0@lo:400: 00000100:00100000:0.0:1787823461.873623:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:3305:x1874668651825280:12345-0@lo:400: Request processed in 58us (4166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823461.873631:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787823461.878203:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792eb06940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651825664:12345-0@lo:400: Request processed in 7067us (7370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823461.878220:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787823461.878274:0:5840:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787823461.878291:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787823461.878306:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790ae80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874668651825536:12345-0@lo:400: 00000100:00100000:2.0:1787823461.878596:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792eb043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874668651825408:12345-0@lo:400: Request processed in 5886us (9046us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823461.878605:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1787823461.878652:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787823461.880015:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790ae80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874668651825536:12345-0@lo:400: Request processed in 1702us (10411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823461.880026:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787823461.881412:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792eb07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651825280:0@lo:400: 00010000:00080000:2.0:1787823461.881621:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e792eb06580 x1874668651825536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787823477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823461.881636:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792eb06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874668651825536:0@lo:400: 00010000:00080000:2.0:1787823461.881650:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e792eb05680 x1874668651825408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787823477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823461.881659:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792eb05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874668651825408:0@lo:400: 00010000:00080000:2.0:1787823461.886476:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e792eb04b40 x1874668651825792/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787823477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823461.886516:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792eb04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874668651825792:0@lo:400: 00010000:00080000:2.0:1787823461.886561:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e792eb04000 x1874668651825664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823461.886571:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792eb04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651825664:0@lo:400: 00010000:00010000:2.0:1787823462.634994:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787823462.897098:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787823462.897106:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e7909bc2800 from 30 10000000:01000000:0.0:1787823462.897112:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787823462.897159:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7900030400/0x5d1142b83248162a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823462.897171:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e7900030400/0x5d1142b83248162a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823462.897181:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e7900030400/0x5d1142b83248162a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823462.897206:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651825920:0@lo:101: 00000100:00100000:0.0:1787823462.897275:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823462.897344:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7907e18a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787823462.904159:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651825920 00000100:00100000:2.0:1787823462.904176:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651825920 00000100:00100000:2.0:1787823462.904889:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787823462.904901:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:5835:x1874668651825920:12345-0@lo:101: 00010000:00010000:2.0:1787823462.904932:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823462.904965:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e79013a2800/0x5d1142b832481631 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b83248162a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823462.904994:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e79013a2800/0x5d1142b832481631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b83248162a expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823462.905006:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e79013a2800/0x5d1142b832481631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b83248162a expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823462.905016:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79013a2800, rc 0) 00000100:00100000:2.0:1787823462.905102:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:5835:x1874668651825920:12345-0@lo:101: Request processed in 204us (7827us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823462.905109:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787823462.907856:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651825920:0@lo:101: 00010000:00010000:3.0:1787823462.907891:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e7900030400/0x5d1142b83248162a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481631 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823462.907905:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e7900030400/0x5d1142b83248162a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b832481631 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823462.908006:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec4da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651826048:0@lo:501: 00000100:00100000:3.0:1787823462.908071:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823462.908113:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e792ea29480 going to sleep for 11 seconds 00000100:00100000:3.0:1787823462.908135:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651826048 00000100:00100000:3.0:1787823462.908141:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651826048 00000100:00100000:3.0:1787823462.908183:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787823462.908192:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:5835:x1874668651826048:12345-0@lo:501: 00000100:00100000:3.0:1787823462.908572:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:5835:x1874668651826048:12345-0@lo:501: Request processed in 380us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823462.908579:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787823462.913443:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec4da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651826048:0@lo:501: 00000100:00100000:1.0:1787823462.913522:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790ae830c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651826176:0@lo:503: 00000100:00100000:1.0:1787823462.913595:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823462.913638:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908c23cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787823462.914172:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651826176 00000100:00100000:3.0:1787823462.914180:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651826176 00000100:00100000:3.0:1787823462.914238:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787823462.914249:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:5835:x1874668651826176:12345-0@lo:503: 00000100:00100000:3.0:1787823462.914597:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:5835:x1874668651826176:12345-0@lo:503: Request processed in 349us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823462.914607:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787823462.914660:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790ae830c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651826176:0@lo:503: 00000100:00100000:3.0:1787823462.914948:0:7928:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec4e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7928:1874668651826304:0@lo:502: 00000100:00100000:3.0:1787823462.915017:0:7928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823462.915049:0:7928:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e792ea29540 going to sleep for 11 seconds 00000100:00100000:2.0:1787823462.915133:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651826304 00000100:00100000:2.0:1787823462.915138:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651826304 00000100:00100000:2.0:1787823462.915173:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787823462.915180:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:7928:x1874668651826304:12345-0@lo:502: 00000100:00100000:2.0:1787823462.915551:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:7928:x1874668651826304:12345-0@lo:502: Request processed in 370us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823462.915558:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787823462.917247:0:7928:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec4e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7928:1874668651826304:0@lo:502: 00000100:00100000:3.0:1787823462.917325:0:7928:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec4e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7928:1874668651826432:0@lo:502: 00000100:00100000:3.0:1787823462.917385:0:7928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823462.917430:0:7928:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e792ea29540 going to sleep for 11 seconds 00000100:00100000:2.0:1787823462.917437:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651826432 00000100:00100000:2.0:1787823462.917445:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651826432 00000100:00100000:2.0:1787823462.917490:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787823462.917509:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:7928:x1874668651826432:12345-0@lo:502: 00000100:00100000:2.0:1787823462.917977:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:7928:x1874668651826432:12345-0@lo:502: Request processed in 476us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823462.917985:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787823462.918108:0:7928:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec4e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7928:1874668651826432:0@lo:502: 00000040:00080000:3.0:1787823462.918132:0:7928:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787823462.918280:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787823462.918298:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787823462.918308:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7900030400/0x5d1142b83248162a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481631 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823462.918319:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e7900030400/0x5d1142b83248162a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481631 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787823462.918330:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787823462.918333:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1787823462.918335:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787823462.918360:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e79013a3800/0x5d1142b832481638 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823462.918367:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e79013a3800/0x5d1142b832481638 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823462.918375:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e79013a3800/0x5d1142b832481638 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823462.918389:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ac86940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651826560:0@lo:101: 00000100:00100000:2.0:1787823462.918421:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823462.918455:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a30ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1787823462.918516:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651826560 00000100:00100000:1.0:1787823462.918520:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651826560 00000100:00100000:1.0:1787823462.918549:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787823462.918556:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:5835:x1874668651826560:12345-0@lo:101: 00010000:00010000:1.0:1787823462.918567:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823462.918579:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7901676600/0x5d1142b83248163f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b832481638 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823462.918601:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7901676600/0x5d1142b83248163f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b832481638 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823462.918614:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7901676600/0x5d1142b83248163f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832481638 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823462.918621:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7901676600, rc 0) 00000100:00100000:1.0:1787823462.918647:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+15:5835:x1874668651826560:12345-0@lo:101: Request processed in 93us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823462.918652:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787823462.918691:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ac86940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651826560:0@lo:101: 00010000:00010000:2.0:1787823462.918707:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e79013a3800/0x5d1142b832481638 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248163f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823462.918715:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e79013a3800/0x5d1142b832481638 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b83248163f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823462.918799:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ac86940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651826688:0@lo:501: 00000100:00100000:2.0:1787823462.918823:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823462.918847:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a30ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1787823462.918856:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651826688 00000100:00100000:1.0:1787823462.918861:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651826688 00000100:00100000:1.0:1787823462.918886:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787823462.918893:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+15:5835:x1874668651826688:12345-0@lo:501: 00000100:00100000:1.0:1787823462.919391:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+15:5835:x1874668651826688:12345-0@lo:501: Request processed in 497us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823462.919400:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787823462.920043:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ac86940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651826688:0@lo:501: 00000100:00100000:3.0:1787823462.920093:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec4e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651826816:0@lo:503: 00000100:00100000:3.0:1787823462.920140:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823462.920176:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e792ea29540 going to sleep for 11 seconds 00000100:00100000:1.0:1787823462.920234:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651826816 00000100:00100000:1.0:1787823462.920239:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651826816 00000100:00100000:1.0:1787823462.920281:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787823462.920289:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+15:5835:x1874668651826816:12345-0@lo:503: 00000100:00100000:1.0:1787823462.920613:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+15:5835:x1874668651826816:12345-0@lo:503: Request processed in 324us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823462.920621:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787823462.921622:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec4e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651826816:0@lo:503: 00000100:00100000:3.0:1787823462.922384:0:7929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec4e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7929:1874668651826944:0@lo:502: 00000100:00100000:3.0:1787823462.922480:0:7929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823462.922521:0:7929:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e792ea29b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787823462.922575:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651826944 00000100:00100000:1.0:1787823462.922580:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651826944 00000100:00100000:1.0:1787823462.922624:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787823462.922634:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+15:7929:x1874668651826944:12345-0@lo:502: 00000100:00100000:1.0:1787823462.922927:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+15:7929:x1874668651826944:12345-0@lo:502: Request processed in 294us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823462.922935:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787823462.923450:0:7929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec4e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7929:1874668651826944:0@lo:502: 00000020:01000000:3.0:1787823462.923480:0:7929:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787823462.923489:0:7929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787823462.923491:0:7929:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787823462.923499:0:7929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787823462.923501:0:7929:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787823462.923523:0:7929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec4e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7929:1874668651827072:0@lo:502: 00000100:00100000:3.0:1787823462.923564:0:7929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823462.923597:0:7929:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e792ea29b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787823462.923654:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651827072 00000100:00100000:1.0:1787823462.923659:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651827072 00000100:00100000:1.0:1787823462.923905:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787823462.923915:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+15:7929:x1874668651827072:12345-0@lo:502: 00000100:00100000:1.0:1787823462.924112:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+15:7929:x1874668651827072:12345-0@lo:502: Request processed in 198us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823462.924117:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787823462.934878:0:7929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec4e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7929:1874668651827072:0@lo:502: 00000020:01000000:1.0:1787823462.935037:0:7929:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787823462.935049:0:7929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787823462.935051:0:7929:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787823462.935056:0:7929:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1787823462.935248:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1787823462.935267:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787823462.935278:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e79013a3800/0x5d1142b832481638 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248163f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823462.935290:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e79013a3800/0x5d1142b832481638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248163f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787823462.935300:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787823462.935302:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e79034dc800 from 30 10000000:01000000:3.0:1787823462.935304:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787823462.935334:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7920eeb800/0x5d1142b832481646 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823462.935342:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e7920eeb800/0x5d1142b832481646 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823462.935350:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e7920eeb800/0x5d1142b832481646 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823462.935369:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec4e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651827200:0@lo:101: 00000100:00100000:3.0:1787823462.935431:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823462.935465:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e792ea29b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787823462.935507:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651827200 00000100:00100000:1.0:1787823462.935513:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651827200 00000100:00100000:1.0:1787823462.935558:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787823462.935567:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+15:5835:x1874668651827200:12345-0@lo:101: 00010000:00010000:1.0:1787823462.935589:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823462.935602:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7901677000/0x5d1142b83248164d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b832481646 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823462.935626:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7901677000/0x5d1142b83248164d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b832481646 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823462.935635:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7901677000/0x5d1142b83248164d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832481646 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823462.935643:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7901677000, rc 0) 00000100:00100000:1.0:1787823462.935878:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+16:5835:x1874668651827200:12345-0@lo:101: Request processed in 311us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823462.935886:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787823462.935952:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec4e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651827200:0@lo:101: 00010000:00010000:3.0:1787823462.935977:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e7920eeb800/0x5d1142b832481646 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248164d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823462.935985:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e7920eeb800/0x5d1142b832481646 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b83248164d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823462.936034:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec4e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651827328:0@lo:501: 00000100:00100000:3.0:1787823462.936060:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823462.936086:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e792ea29b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787823462.936168:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651827328 00000100:00100000:1.0:1787823462.936173:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651827328 00000100:00100000:1.0:1787823462.936198:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787823462.936207:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+16:5835:x1874668651827328:12345-0@lo:501: 00000100:00100000:1.0:1787823462.936472:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+16:5835:x1874668651827328:12345-0@lo:501: Request processed in 266us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823462.936479:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787823462.936502:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec4e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651827328:0@lo:501: 00000100:00100000:2.0:1787823462.936535:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ac86940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651827456:0@lo:503: 00000100:00100000:2.0:1787823462.936576:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823462.936594:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a30c600 going to sleep for 11 seconds 00000100:00100000:1.0:1787823462.943633:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651827456 00000100:00100000:1.0:1787823462.943650:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651827456 00000100:00100000:1.0:1787823462.943709:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787823462.943720:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+16:5835:x1874668651827456:12345-0@lo:503: 00000100:00100000:1.0:1787823462.943991:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+16:5835:x1874668651827456:12345-0@lo:503: Request processed in 272us (7413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823462.944001:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787823462.944083:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ac86940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651827456:0@lo:503: 00000100:00100000:3.0:1787823462.948110:0:7932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec4c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7932:1874668651827584:0@lo:502: 00000100:00100000:3.0:1787823462.948200:0:7932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823462.948276:0:7932:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e792ea29480 going to sleep for 11 seconds 00000100:00100000:1.0:1787823462.949566:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651827584 00000100:00100000:1.0:1787823462.949576:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651827584 00000100:00100000:1.0:1787823462.950034:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787823462.950047:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+16:7932:x1874668651827584:12345-0@lo:502: 00000100:00100000:1.0:1787823462.950332:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+16:7932:x1874668651827584:12345-0@lo:502: Request processed in 287us (2131us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823462.950340:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787823462.950410:0:7932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec4c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7932:1874668651827584:0@lo:502: 00000100:00100000:2.0:1787823462.950477:0:7932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ac87840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7932:1874668651827712:0@lo:502: 00000100:00100000:2.0:1787823462.950521:0:7932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823462.950551:0:7932:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a30ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787823462.950563:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651827712 00000100:00100000:3.0:1787823462.950569:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651827712 00000100:00100000:3.0:1787823462.950606:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787823462.950613:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+16:7932:x1874668651827712:12345-0@lo:502: 00000100:00100000:2.0:1787823462.950812:0:7932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ac87840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7932:1874668651827712:0@lo:502: 00000040:00080000:2.0:1787823462.950831:0:7932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1787823462.950919:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787823462.950948:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787823462.950969:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7920eeb800/0x5d1142b832481646 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248164d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823462.950981:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e7920eeb800/0x5d1142b832481646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248164d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787823462.950990:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787823462.950993:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e79034dc800 from 5 10000000:01000000:1.0:1787823462.950996:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787823462.951021:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b832481654 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823462.951030:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b832481654 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823462.951039:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b832481654 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823462.951053:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790ae80780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651827840:0@lo:101: 00000100:00100000:1.0:1787823462.951092:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823462.951113:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79186720c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787823462.951125:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651827840 00000100:00100000:1.0:1787823462.951129:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651827840 00000100:00100000:1.0:1787823462.951148:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787823462.951156:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:5835:x1874668651827840:12345-0@lo:101: 00010000:00010000:1.0:1787823462.951165:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823462.951178:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7901677200/0x5d1142b83248165b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b832481654 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823462.951198:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7901677200/0x5d1142b83248165b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b832481654 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823462.951208:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7901677200/0x5d1142b83248165b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832481654 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823462.951215:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7901677200, rc 0) 00000100:00100000:1.0:1787823462.951245:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:5835:x1874668651827840:12345-0@lo:101: Request processed in 90us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823462.951252:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787823462.951282:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790ae80780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651827840:0@lo:101: 00010000:00010000:1.0:1787823462.951294:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b832481654 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248165b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823462.951303:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b832481654 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b83248165b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823462.951344:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790ae80780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651827968:0@lo:256: 00000100:00100000:1.0:1787823462.951381:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823462.951395:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79186720c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787823462.951407:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651827968 00000100:00100000:1.0:1787823462.951410:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651827968 00000100:00100000:1.0:1787823462.951427:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787823462.951434:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:5835:x1874668651827968:12345-0@lo:256: 20000000:01000000:1.0:1787823462.951447:0:5831:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787823462.951462:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787823462.951464:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1787823462.951530:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:5835:x1874668651827968:12345-0@lo:256: Request processed in 96us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823462.951537:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787823462.951564:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790ae80780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651827968:0@lo:256: 10000000:01000000:1.0:1787823462.951603:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787823462.951608:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b832481654 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248165b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823462.951616:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b832481654 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248165b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787823462.951623:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787823462.951624:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1787823462.951626:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787823462.951640:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7901676c00/0x5d1142b832481662 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823462.951647:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e7901676c00/0x5d1142b832481662 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823462.951666:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e7901676c00/0x5d1142b832481662 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823462.951677:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790ae80780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651828096:0@lo:101: 00000100:00100000:1.0:1787823462.951704:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823462.951718:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79186720c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787823462.951729:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651828096 00000100:00100000:1.0:1787823462.951732:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651828096 00000100:00100000:1.0:1787823462.951749:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787823462.951755:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:5835:x1874668651828096:12345-0@lo:101: 00000100:00100000:3.0:1787823462.951951:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:7932:x1874668651827712:12345-0@lo:502: Request processed in 1336us (1428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823462.951966:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00010000:1.0:1787823462.952112:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823462.952123:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7901676a00/0x5d1142b832481669 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b832481662 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823462.952139:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7901676a00/0x5d1142b832481669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b832481662 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823462.952148:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7901676a00/0x5d1142b832481669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832481662 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823462.952155:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7901676a00, rc 0) 00000100:00100000:1.0:1787823462.952234:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:5835:x1874668651828096:12345-0@lo:101: Request processed in 478us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823462.952240:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787823462.952292:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790ae80780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651828096:0@lo:101: 00010000:00010000:3.0:1787823462.952304:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e7901676c00/0x5d1142b832481662 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481669 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823462.952312:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e7901676c00/0x5d1142b832481662 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b832481669 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823462.952355:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec4d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651828224:0@lo:501: 00000100:00100000:3.0:1787823462.952381:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823462.952447:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e792ea29240 going to sleep for 11 seconds 00000100:00100000:1.0:1787823462.952488:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651828224 00000100:00100000:1.0:1787823462.952493:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651828224 00000100:00100000:1.0:1787823462.952558:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787823462.952566:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:5835:x1874668651828224:12345-0@lo:501: 00000100:00100000:1.0:1787823462.952849:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:5835:x1874668651828224:12345-0@lo:501: Request processed in 284us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823462.952856:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787823462.953022:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec4d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651828224:0@lo:501: 00000100:00100000:3.0:1787823462.953050:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec4d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651828352:0@lo:503: 00000100:00100000:3.0:1787823462.953093:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823462.953109:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e792ea29240 going to sleep for 11 seconds 00000100:00100000:3.0:1787823462.953124:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651828352 00000100:00100000:3.0:1787823462.953127:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651828352 00000100:00100000:3.0:1787823462.953160:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787823462.953166:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:5835:x1874668651828352:12345-0@lo:503: 00000100:00100000:3.0:1787823462.953450:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:5835:x1874668651828352:12345-0@lo:503: Request processed in 283us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823462.953457:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787823462.953495:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec4d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651828352:0@lo:503: 00000100:00100000:3.0:1787823462.953663:0:7933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec4d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7933:1874668651828480:0@lo:502: 00000100:00100000:3.0:1787823462.953697:0:7933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823462.953715:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651828480 00000100:00100000:3.0:1787823462.953719:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651828480 00000100:00100000:3.0:1787823462.953739:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787823462.953745:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:7933:x1874668651828480:12345-0@lo:502: 00000100:00100000:3.0:1787823462.954102:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:7933:x1874668651828480:12345-0@lo:502: Request processed in 355us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823462.954109:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787823462.954135:0:7933:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e792ea29540 going to sleep for 11 seconds 00000100:00100000:3.0:1787823462.954148:0:7933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec4d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7933:1874668651828480:0@lo:502: 00000020:01000000:3.0:1787823462.954169:0:7933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787823462.954176:0:7933:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787823462.954183:0:7933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787823462.954185:0:7933:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787823462.954192:0:7933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787823462.954201:0:7933:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.135@tcp to nid 0x20000c0a8ca87 (192.168.202.135@tcp) 00000020:01000000:3.0:1787823462.954223:0:7933:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787823462.954226:0:7933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787823462.954250:0:7933:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8e7939cbcd70) 00000020:00000080:3.0:1787823462.954271:0:7933:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1787823462.954277:0:7933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787823462.954352:0:7933:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787823462.954357:0:7933:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787823462.954364:0:7933:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d1142b832481677 00010000:00080000:3.0:1787823462.954392:0:7933:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e793a14c000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.135@tcp at head 00010000:00010000:3.0:1787823462.954602:0:7933:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1787823462.955140:0:7933:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1787823462.955152:0:7933:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787823462.955678:0:7933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787823462.956186:0:7933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787823462.956236:0:7933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1787823462.956287:0:7933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1787823462.957212:0:7934:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787823462.957217:0:7934:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787823462.958193:0:7933:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787823462.958204:0:7933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787823462.958245:0:7933:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787823462.958269:0:7933:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d1142b83248167e 00000100:00080000:2.0:1787823462.958281:0:7933:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787823462.958288:0:7933:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e793a14c000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:2.0:1787823462.958322:0:7933:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e791ac87840 x1874668651828608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787823462.958349:0:7933:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787823462.958398:0:7933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787823462.958402:0:7933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787823462.958410:0:7933:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787823462.958414:0:7933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787823462.958417:0:7933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787823462.958419:0:7933:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787823462.958422:0:7933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787823462.958423:0:7933:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787823462.958452:0:7933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ac84f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7933:1874668651828736:0@lo:502: 00000100:00100000:2.0:1787823462.958524:0:7933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823462.958563:0:7933:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a30c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787823462.958628:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ac87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874668651828608:0@lo:8: 00000100:00100000:3.0:1787823462.958665:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823462.958743:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651828608 00000100:00100000:2.0:1787823462.958749:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651828608 00000100:00100000:2.0:1787823462.958898:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787823462.958906:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1874668651828608:12345-0@lo:8: 00010000:00080000:2.0:1787823462.958929:0:6688:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:2.0:1787823462.958952:0:6688:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d1142b832481685 00002000:00100000:2.0:1787823462.958978:0:6688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8e7939c87000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787823462.958982:0:6688:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1787823462.958986:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787823462.959103:0:6688:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787823462.959268:0:6688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787823462.959292:0:6688:0:(import.c:65:import_set_state_nolock()) ffff8e7939c83000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787823462.959352:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1874668651828608:12345-0@lo:8: Request processed in 445us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823462.959361:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787823462.959577:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e791ac87840 x1874668651828608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787823472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823462.959588:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787823462.959596:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787823462.959602:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787823462.959607:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787823462.959609:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8e793a14c000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787823462.959620:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787823462.959631:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ac87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874668651828608:0@lo:8: 00000004:00080000:3.0:1787823462.959654:0:7934:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787823462.959742:0:7934:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 203813982792ns, next at 0ns, rc = 0 00000100:00100000:3.0:1787823462.963096:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787823462.963204:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787823462.963226:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790ae80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874668651828992:0@lo:400: 00000100:00100000:2.0:1787823462.963300:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823462.963370:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790ae81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874668651828864:0@lo:400: 00000100:00100000:3.0:1787823462.968262:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823462.968451:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651828992 00000100:00100000:1.0:1787823462.968460:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651828992 00000100:00100000:1.0:1787823462.968507:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651828864 00000100:00100000:1.0:1787823462.968509:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651828864 00000100:00100000:1.0:1787823462.968530:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787823462.968538:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ac87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874668651828992:12345-0@lo:400: 00000100:00100000:1.0:1787823462.968617:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ac87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874668651828992:12345-0@lo:400: Request processed in 78us (5317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823462.968624:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787823462.968639:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787823462.968645:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874668651828864:12345-0@lo:400: 00000100:00100000:1.0:1787823462.968677:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874668651828864:12345-0@lo:400: Request processed in 32us (5275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823462.968683:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1787823462.968872:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e790ae81680 x1874668651828864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787823478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823462.968890:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790ae81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874668651828864:0@lo:400: 00010000:00080000:1.0:1787823462.976826:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e790ae80780 x1874668651828992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787823478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787823462.976847:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790ae80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874668651828992:0@lo:400: 00000100:00100000:1.0:1787823462.976887:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651828736 00000100:00100000:1.0:1787823462.976895:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651828736 00000100:00100000:1.0:1787823462.977630:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787823462.977640:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:7933:x1874668651828736:12345-0@lo:502: 00000100:00100000:1.0:1787823462.977975:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:7933:x1874668651828736:12345-0@lo:502: Request processed in 335us (19451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823462.977992:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787823462.978098:0:7933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ac84f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:7933:1874668651828736:0@lo:502: 00000020:01000000:2.0:1787823462.978137:0:7933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787823462.978144:0:7933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787823462.978147:0:7933:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787823462.978151:0:7933:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1787823462.978459:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1787823462.978477:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787823462.978487:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7901676c00/0x5d1142b832481662 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481669 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823462.978499:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e7901676c00/0x5d1142b832481662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481669 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787823462.978509:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787823462.978511:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e7906ef0000 from 1 10000000:01000000:3.0:1787823462.978514:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787823462.978545:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b83248168c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823462.978554:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b83248168c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823462.978564:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b83248168c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823462.978595:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec4e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651829120:0@lo:101: 00000100:00100000:3.0:1787823462.978632:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823462.978676:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7909a44180 going to sleep for 11 seconds 00000100:00100000:2.0:1787823462.978726:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651829120 00000100:00100000:2.0:1787823462.978732:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651829120 00000100:00100000:2.0:1787823462.978803:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787823462.978813:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:5835:x1874668651829120:12345-0@lo:101: 00010000:00010000:2.0:1787823462.978824:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823462.978851:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e79358d3c00/0x5d1142b832481693 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b83248168c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823462.978875:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e79358d3c00/0x5d1142b832481693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b83248168c expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823462.978886:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e79358d3c00/0x5d1142b832481693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b83248168c expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823462.978894:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d3c00, rc 0) 00000100:00100000:2.0:1787823462.978938:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:5835:x1874668651829120:12345-0@lo:101: Request processed in 126us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823462.978945:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787823462.979003:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec4e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651829120:0@lo:101: 00010000:00010000:2.0:1787823462.979018:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b83248168c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481693 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823462.979026:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b83248168c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b832481693 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823462.979078:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ac84f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651829248:0@lo:501: 00000100:00100000:2.0:1787823462.979105:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823462.979124:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a30c000 going to sleep for 11 seconds 00000100:00100000:2.0:1787823462.979135:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651829248 00000100:00100000:2.0:1787823462.979138:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651829248 00000100:00100000:2.0:1787823462.979154:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787823462.979160:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:5835:x1874668651829248:12345-0@lo:501: 00000100:00100000:2.0:1787823462.979338:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:5835:x1874668651829248:12345-0@lo:501: Request processed in 177us (233us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787823462.979345:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787823462.979372:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ac84f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651829248:0@lo:501: 10000000:01000000:2.0:1787823462.979393:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787823462.979398:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b83248168c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481693 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823462.979405:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b83248168c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481693 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823462.984680:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790ae80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651829376:0@lo:400: 00000100:00100000:3.0:1787823462.984786:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823462.984971:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651829376 00000100:00100000:1.0:1787823462.984979:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651829376 00000100:00100000:1.0:1787823462.985045:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787823462.985054:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651829376:12345-0@lo:400: 00000100:00100000:1.0:1787823462.987940:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651829376:12345-0@lo:400: Request processed in 2874us (3142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823462.987965:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787823462.988006:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787823462.988087:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790ae830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874668651829504:0@lo:400: 00000100:00100000:1.0:1787823462.988142:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823462.988179:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651829504 00000100:00100000:1.0:1787823462.988186:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651829504 00000100:00100000:1.0:1787823462.988221:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787823462.988228:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790ae81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874668651829504:12345-0@lo:400: 00000100:00100000:1.0:1787823462.988270:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790ae81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874668651829504:12345-0@lo:400: Request processed in 43us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823462.988276:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1787823462.988308:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e790ae830c0 x1874668651829504/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787823478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787823462.988321:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790ae830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874668651829504:0@lo:400: 00010000:00080000:3.0:1787823462.992571:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e790ae80780 x1874668651829376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823462.992591:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790ae80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651829376:0@lo:400: 00000004:00080000:3.0:1787823463.060342:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1787823463.085740:0:7935:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787823463.085814:0:7935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec4fc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7935:1874668651829760:0@lo:7: 00000100:00100000:3.0:1787823463.086023:0:7935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823463.086072:0:7935:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793b31f180 going to sleep for 11 seconds 00000100:00100000:3.0:1787823463.086087:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787823463.086160:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec4e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651829632:0@lo:13: 00000100:00100000:3.0:1787823463.086186:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823463.086213:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651829632 00000100:00100000:3.0:1787823463.086216:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651829760 00000100:00100000:3.0:1787823463.086221:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651829760 00000100:00100000:0.0:1787823463.086222:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651829632 00000100:00100000:3.0:1787823463.086282:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787823463.086819:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787823463.086852:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7935:x1874668651829760:12345-0@lo:7: 00000100:00100000:0.0:1787823463.086874:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787823463.086881:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1874668651829632:12345-0@lo:13: 00002000:00000024:0.0:1787823463.086916:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1787823463.086998:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1874668651829632:12345-0@lo:13: Request processed in 117us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823463.087005:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787823463.087052:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e792ec4e1c0 x1874668651829632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823479 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823463.087071:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec4e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651829632:0@lo:13: 00002000:00080000:3.0:1787823463.093659:0:6686:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1787823463.093735:0:6686:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787823463.093935:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7935:x1874668651829760:12345-0@lo:7: Request processed in 7560us (7828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823463.093949:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787823463.094027:0:7935:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e792ec4fc00 x1874668651829760/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787823479 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823463.094043:0:7935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec4fc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7935:1874668651829760:0@lo:7: 00000004:00080000:3.0:1787823463.094056:0:7935:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787823463.094228:0:7935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec4fc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7935:1874668651829888:0@lo:5: 00000100:00100000:3.0:1787823463.094265:0:7935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823463.094372:0:7935:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793b31f180 going to sleep for 11 seconds 00000100:00100000:0.0:1787823463.094417:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651829888 00000100:00100000:0.0:1787823463.094424:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651829888 00000100:00100000:0.0:1787823463.094463:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787823463.094471:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7935:x1874668651829888:12345-0@lo:5: 00002000:00080000:0.0:1787823463.094498:0:6688:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787823463.094502:0:6688:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1787823463.094804:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7935:x1874668651829888:12345-0@lo:5: Request processed in 333us (538us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787823463.094811:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787823463.094838:0:7935:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e792ec4fc00 x1874668651829888/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787823479 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823463.094849:0:7935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec4fc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7935:1874668651829888:0@lo:5: 00000004:00080000:0.0:1787823463.094869:0:7935:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787823463.094893:0:7935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef30c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7935:1874668651830016:0@lo:700: 00000100:00100000:0.0:1787823463.094915:0:7935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823463.094939:0:7935:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7907e18d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787823463.094951:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651830016 00000100:00100000:0.0:1787823463.094963:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651830016 00000100:00100000:0.0:1787823463.094988:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787823463.094994:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790aef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7935:x1874668651830016:12345-0@lo:700: 00000100:00100000:0.0:1787823463.095030:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef0000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6694:1874668651830144:0@lo:700: 00000100:00100000:0.0:1787823463.095056:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823463.095077:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7907e186c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787823463.095093:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651830144 00000100:00100000:0.0:1787823463.095108:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651830144 00000100:00100000:0.0:1787823463.095137:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787823463.095144:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790aef2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6694:x1874668651830144:12345-0@lo:700: 00000100:00080000:1.0:1787823463.096850:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 40000000:02000000:0.0:1787823463.140419:0:5845:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1787823463.149239:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790aef2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6694:x1874668651830144:12345-0@lo:700: Request processed in 54084us (54170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823463.149255:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787823463.149315:0:6694:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e790aef0000 x1874668651830144/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787823479 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823463.149333:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef0000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6694:1874668651830144:0@lo:700: 40000000:02000000:0.0:1787823463.149347:0:6694:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:3.0:1787823463.252279:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787823463.252279:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:1.0:1787823463.252912:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790aef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7935:x1874668651830016:12345-0@lo:700: Request processed in 157912us (157990us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823463.252932:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787823463.254855:0:7935:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e790aef30c0 x1874668651830016/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787823479 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823463.254872:0:7935:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787823463.254889:0:7935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef30c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7935:1874668651830016:0@lo:700: 00000004:02000040:1.0:1787823463.306044:0:7935:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1787823463.311495:0:7935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790ae830c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7935:1874668651830272:0@lo:5: 00000100:00100000:1.0:1787823463.311582:0:7935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823463.311826:0:7935:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7910029180 going to sleep for 11 seconds 00000100:00100000:0.0:1787823463.311837:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651830272 00000100:00100000:0.0:1787823463.311844:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651830272 00000100:00100000:0.0:1787823463.312291:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787823463.312302:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790ae80780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7935:x1874668651830272:12345-0@lo:5: 00002000:00080000:0.0:1787823463.316625:0:6688:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1787823463.316649:0:6688:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1787823463.320440:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790ae80780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7935:x1874668651830272:12345-0@lo:5: Request processed in 8132us (8849us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787823463.320453:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787823463.320569:0:7935:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e790ae830c0 x1874668651830272/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787823479 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823463.320587:0:7935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790ae830c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7935:1874668651830272:0@lo:5: 00000004:00080000:0.0:1787823463.320602:0:7935:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:2.0:1787823463.657934:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787823463.939427:0:7995:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg235-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787823464.685465:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823465.705950:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823465.966044:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec4c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651830400:0@lo:13: 00000100:00100000:1.0:1787823465.966131:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823465.966232:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651830400 00000100:00100000:2.0:1787823465.966241:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651830400 00000100:00100000:2.0:1787823465.966301:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787823465.966311:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926246940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651830400:12345-0@lo:13: 00002000:00000024:2.0:1787823465.966349:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787823465.968957:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787823465.972719:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926246940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651830400:12345-0@lo:13: Request processed in 6399us (6577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823465.972742:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787823465.972995:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e792ec4c780 x1874668651830400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823481 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787823465.973023:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec4c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651830400:0@lo:13: 00010000:00010000:2.0:1787823466.730009:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823467.756406:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823468.010343:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787823468.013859:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874668651830656:0@lo:400: 00000100:00100000:1.0:1787823468.013938:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823468.013993:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651830528:0@lo:400: 00000100:00100000:1.0:1787823468.014021:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823468.014081:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651830656 00000100:00100000:1.0:1787823468.014088:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651830656 00000100:00100000:1.0:1787823468.014135:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787823468.014144:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79262452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874668651830656:12345-0@lo:400: 00000100:00100000:1.0:1787823468.014197:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79262452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874668651830656:12345-0@lo:400: Request processed in 53us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823468.014204:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787823468.014239:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651830528 00000100:00100000:1.0:1787823468.014243:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651830528 00000100:00100000:1.0:1787823468.015774:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787823468.015794:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3306:x1874668651830528:12345-0@lo:400: 00000100:00100000:1.0:1787823468.015878:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3306:x1874668651830528:12345-0@lo:400: Request processed in 93us (1856us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823468.015886:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:1.0:1787823468.015973:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e790aef0000 x1874668651830656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787823484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787823468.015987:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874668651830656:0@lo:400: 00000100:00100000:1.0:1787823468.015997:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651830528:0@lo:400: 00000100:00100000:3.0:1787823468.018496:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874668651831040:0@lo:400: 00000100:00100000:3.0:1787823468.018567:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823468.018624:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651831040 00000100:00100000:3.0:1787823468.018631:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651831040 00000100:00100000:3.0:1787823468.018682:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787823468.018690:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874668651831040:12345-0@lo:400: 00000100:00100000:3.0:1787823468.018737:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874668651831040:12345-0@lo:400: Request processed in 47us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823468.018743:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1787823468.018823:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787823468.018868:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e792ec4f480 x1874668651831040/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787823484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823468.018880:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874668651831040:0@lo:400: 00000100:00100000:3.0:1787823468.018941:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787823468.018947:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651831168:0@lo:400: 00000100:00100000:3.0:1787823468.018973:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823468.018998:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651831168 00000100:00100000:3.0:1787823468.019001:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651831168 00000100:00100000:3.0:1787823468.019030:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787823468.019036:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1874668651831168:12345-0@lo:400: 00000100:00100000:3.0:1787823468.019321:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1874668651831168:12345-0@lo:400: Request processed in 284us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823468.019329:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787823468.019345:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787823468.019362:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e792ec4f480 x1874668651831168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823468.019371:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651831168:0@lo:400: 00000100:00100000:1.0:1787823468.021296:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec4cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874668651830784:0@lo:400: 00000100:00100000:1.0:1787823468.021370:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823468.021414:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787823468.021421:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec4f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651830912:0@lo:400: 00000100:00100000:1.0:1787823468.021444:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823468.021476:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651830784 00000100:00100000:1.0:1787823468.021482:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651830784 00000100:00100000:1.0:1787823468.021543:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787823468.021551:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926246d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874668651830784:12345-0@lo:400: 00000100:00100000:1.0:1787823468.021598:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926246d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874668651830784:12345-0@lo:400: Request processed in 47us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823468.021605:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787823468.021627:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651830912 00000100:00100000:1.0:1787823468.021631:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651830912 00000100:00100000:1.0:1787823468.021654:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787823468.021660:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926244b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651830912:12345-0@lo:400: 00000100:00100000:1.0:1787823468.021689:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926244b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651830912:12345-0@lo:400: Request processed in 29us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823468.021704:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1787823468.021732:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787823468.021736:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787823468.021792:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e792ec4f0c0 x1874668651830912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787823468.021804:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec4f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651830912:0@lo:400: 00010000:00080000:1.0:1787823468.021816:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e792ec4cf00 x1874668651830784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787823484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787823468.021824:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec4cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874668651830784:0@lo:400: 00000100:00100000:1.0:1787823468.526352:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787823468.526380:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e79262443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651831296:0@lo:13: 00000100:00100000:1.0:1787823468.526448:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823468.526517:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651831296 00000100:00100000:1.0:1787823468.526525:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651831296 00000100:00100000:1.0:1787823468.526572:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787823468.526586:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926246580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1874668651831296:12345-0@lo:13: 00002000:00000024:1.0:1787823468.526621:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787823468.526677:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926246580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1874668651831296:12345-0@lo:13: Request processed in 92us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823468.526684:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787823468.526735:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e79262443c0 x1874668651831296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823484 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787823468.526754:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e79262443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651831296:0@lo:13: 00000001:00080000:2.0:1787823468.655462:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1787823468.778544:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823469.802429:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823470.664331:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823470.664459:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629787008 00000100:00100000:1.0:1787823470.664483:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629787008 00000100:00100000:1.0:1787823470.664537:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 113 00000100:00100000:1.0:1787823470.664547:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2351:x1874668629787008:12345-192.168.202.35@tcp:250: 00010000:00080000:1.0:1787823470.664583:0:5833:0:(ldlm_lib.c:1454:target_handle_connect()) MGS: connection from 29690577-71bc-48f4-b24d-bdb875faaf85@192.168.202.35@tcp t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:1.0:1787823470.664620:0:5833:0:(genops.c:1385:class_connect()) connect: client 29690577-71bc-48f4-b24d-bdb875faaf85, cookie 0x5d1142b83248169a 00000100:00080000:1.0:1787823470.664816:0:5833:0:(import.c:65:import_set_state_nolock()) ffff8e7909b94000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787823470.664903:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+5:2351:x1874668629787008:12345-192.168.202.35@tcp:250: Request processed in 355us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823470.664912:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 113 00000100:00100000:3.0:1787823470.667048:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823470.679693:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629786880 00000100:00100000:0.0:1787823470.679714:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629786880 00000100:00100000:0.0:1787823470.679805:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 114 00000100:00100000:0.0:1787823470.679817:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+5:5581:x1874668629786880:12345-192.168.202.35@tcp:101: 00010000:00010000:0.0:1787823470.679835:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823470.679857:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7900030000/0x5d1142b8324816a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe697ab316f445a5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823470.679910:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7900030000/0x5d1142b8324816a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f445a5 expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823470.679923:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7900030000/0x5d1142b8324816a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f445a5 expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823470.679933:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7900030000, rc 0) 00000100:00100000:0.0:1787823470.680026:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+6:5581:x1874668629786880:12345-192.168.202.35@tcp:101: Request processed in 211us (12997us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823470.680033:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 114 00000100:00100000:3.0:1787823470.692604:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823470.693004:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629787136 00000100:00100000:2.0:1787823470.693017:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629787136 00000100:00100000:2.0:1787823470.693087:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 115 00000100:00100000:2.0:1787823470.693108:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903726450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+6:5581:x1874668629787136:12345-192.168.202.35@tcp:501: 00000100:00100000:2.0:1787823470.693513:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903726450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+6:5581:x1874668629787136:12345-192.168.202.35@tcp:501: Request processed in 406us (917us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787823470.693522:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 115 00000100:00100000:3.0:1787823470.706413:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823470.707226:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629787264 00000100:00100000:1.0:1787823470.707239:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629787264 00000100:00100000:1.0:1787823470.707304:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 116 00000100:00100000:1.0:1787823470.707314:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+6:5581:x1874668629787264:12345-192.168.202.35@tcp:101: 00010000:00010000:1.0:1787823470.707332:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823470.707352:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7901677600/0x5d1142b8324816a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe697ab316f445ac expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823470.707383:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7901677600/0x5d1142b8324816a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f445ac expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823470.707394:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7901677600/0x5d1142b8324816a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f445ac expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823470.707402:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7901677600, rc 0) 00000100:00100000:1.0:1787823470.707474:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+7:5581:x1874668629787264:12345-192.168.202.35@tcp:101: Request processed in 161us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823470.707481:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 116 00000100:00100000:3.0:1787823470.713484:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823470.713727:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629787392 00000100:00100000:0.0:1787823470.713739:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629787392 00000100:00100000:0.0:1787823470.713825:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 117 00000100:00100000:0.0:1787823470.713849:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+7:5581:x1874668629787392:12345-192.168.202.35@tcp:501: 00000100:00100000:0.0:1787823470.714238:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+8:5581:x1874668629787392:12345-192.168.202.35@tcp:501: Request processed in 389us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823470.714247:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 117 00000100:00100000:3.0:1787823470.716555:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823470.716670:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629787520 00000100:00100000:2.0:1787823470.716679:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629787520 00000100:00100000:2.0:1787823470.716736:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 118 00000100:00100000:2.0:1787823470.716747:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903727450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+8:5581:x1874668629787520:12345-192.168.202.35@tcp:503: 00000100:00100000:2.0:1787823470.717223:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903727450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+8:5581:x1874668629787520:12345-192.168.202.35@tcp:503: Request processed in 475us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823470.717232:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 118 00000100:00100000:3.0:1787823470.733335:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823470.733604:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629787648 00000100:00100000:1.0:1787823470.733632:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629787648 00000100:00100000:1.0:1787823470.733689:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 119 00000100:00100000:1.0:1787823470.733698:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903727850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+8:5599:x1874668629787648:12345-192.168.202.35@tcp:502: 00000100:00100000:1.0:1787823470.734073:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903727850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+8:5599:x1874668629787648:12345-192.168.202.35@tcp:502: Request processed in 375us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823470.734082:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 119 00000100:00100000:3.0:1787823470.786525:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823470.788082:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629787776 00000100:00100000:0.0:1787823470.788103:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629787776 00000100:00100000:0.0:1787823470.788195:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 120 00000100:00100000:0.0:1787823470.788206:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903724450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+8:5599:x1874668629787776:12345-192.168.202.35@tcp:502: 00000100:00100000:0.0:1787823470.788526:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903724450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+8:5599:x1874668629787776:12345-192.168.202.35@tcp:502: Request processed in 321us (2010us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823470.788534:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 120 00000100:00100000:3.0:1787823470.807579:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823470.807707:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629787904 00000100:00100000:2.0:1787823470.807720:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629787904 00000100:00100000:2.0:1787823470.807811:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 121 00000100:00100000:2.0:1787823470.807823:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+8:5581:x1874668629787904:12345-192.168.202.35@tcp:101: 00010000:00010000:2.0:1787823470.807842:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823470.807859:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e79358d2600/0x5d1142b8324816af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe697ab316f445d6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823470.807902:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e79358d2600/0x5d1142b8324816af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f445d6 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823470.807933:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e79358d2600/0x5d1142b8324816af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f445d6 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823470.807942:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d2600, rc 0) 00000100:00100000:2.0:1787823470.808008:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+9:5581:x1874668629787904:12345-192.168.202.35@tcp:101: Request processed in 187us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823470.808015:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 121 00000100:00100000:3.0:1787823470.812730:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823470.813652:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629788032 00000100:00100000:0.0:1787823470.813665:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629788032 00000100:00100000:0.0:1787823470.813738:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 122 00000100:00100000:0.0:1787823470.813750:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903726850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+9:5581:x1874668629788032:12345-192.168.202.35@tcp:256: 20000000:01000000:0.0:1787823470.813808:0:5832:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787823470.813834:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787823470.813839:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787823470.813842:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787823470.813844:0:5832:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1787823470.816828:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903726850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+9:5581:x1874668629788032:12345-192.168.202.35@tcp:256: Request processed in 3068us (4098us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823470.816844:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 122 00000100:00100000:3.0:1787823470.820472:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823470.820566:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629788160 00000100:00100000:2.0:1787823470.820575:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629788160 00000100:00100000:2.0:1787823470.820629:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 123 00000100:00100000:2.0:1787823470.820639:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+9:5581:x1874668629788160:12345-192.168.202.35@tcp:101: 00010000:00010000:2.0:1787823470.820655:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823470.820672:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e79358d2c00/0x5d1142b8324816b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe697ab316f445dd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823470.820700:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e79358d2c00/0x5d1142b8324816b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f445dd expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823470.820711:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e79358d2c00/0x5d1142b8324816b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f445dd expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823470.820718:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d2c00, rc 0) 00000100:00100000:2.0:1787823470.820787:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+10:5581:x1874668629788160:12345-192.168.202.35@tcp:101: Request processed in 150us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823470.820792:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 123 00000100:00100000:3.0:1787823470.822934:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823470.823083:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629788288 00000100:00100000:0.0:1787823470.823093:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629788288 00000100:00100000:0.0:1787823470.823159:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 124 00000100:00100000:0.0:1787823470.823170:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+10:5581:x1874668629788288:12345-192.168.202.35@tcp:501: 00000100:00100000:0.0:1787823470.823510:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+10:5581:x1874668629788288:12345-192.168.202.35@tcp:501: Request processed in 341us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823470.823519:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 124 00000100:00100000:3.0:1787823470.828705:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00010000:00010000:2.0:1787823470.828837:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823470.829188:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629788416 00000100:00100000:1.0:1787823470.829199:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629788416 00000100:00100000:1.0:1787823470.829251:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 125 00000100:00100000:1.0:1787823470.829259:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+10:5581:x1874668629788416:12345-192.168.202.35@tcp:503: 00000100:00100000:1.0:1787823470.829580:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+10:5581:x1874668629788416:12345-192.168.202.35@tcp:503: Request processed in 321us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823470.829585:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 125 00000100:00100000:3.0:1787823470.832679:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823470.832968:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629788544 00000100:00100000:1.0:1787823470.832979:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629788544 00000100:00100000:1.0:1787823470.833139:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 126 00000100:00100000:1.0:1787823470.833151:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7908c44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+10:5603:x1874668629788544:12345-192.168.202.35@tcp:502: 00000100:00100000:1.0:1787823470.833459:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7908c44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+10:5603:x1874668629788544:12345-192.168.202.35@tcp:502: Request processed in 310us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823470.833468:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 126 00000100:00100000:3.0:1787823470.836140:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823470.836596:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629788672 00000100:00100000:0.0:1787823470.836664:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629788672 00000100:00100000:0.0:1787823470.836720:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 127 00000100:00100000:0.0:1787823470.836727:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7908c45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+10:5603:x1874668629788672:12345-192.168.202.35@tcp:502: 00000100:00100000:0.0:1787823470.837292:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7908c45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+10:5603:x1874668629788672:12345-192.168.202.35@tcp:502: Request processed in 564us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823470.837299:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 127 00000100:00100000:3.0:1787823470.840216:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823470.840318:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629788800 00000100:00100000:1.0:1787823470.840326:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629788800 00000100:00100000:1.0:1787823470.840369:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 4 00000100:00100000:1.0:1787823470.840375:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2351:x1874668629788800:12345-192.168.202.35@tcp:38: 00010000:00080000:1.0:1787823470.840400:0:5838:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from 353832f0-fe7b-4d99-975c-a8041babed42@192.168.202.35@tcp t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:1.0:1787823470.840443:0:5838:0:(genops.c:1385:class_connect()) connect: client 353832f0-fe7b-4d99-975c-a8041babed42, cookie 0x5d1142b8324816bd 00000004:00100000:1.0:1787823470.840479:0:5838:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1787823470.840485:0:5838:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1787823470.874284:0:5838:0:(import.c:65:import_set_state_nolock()) ffff8e793a14f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787823470.874446:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+6:2351:x1874668629788800:12345-192.168.202.35@tcp:38: Request processed in 34068us (34240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823470.874459:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 4 00000100:00100000:2.0:1787823471.087341:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787823471.087384:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec4fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651831424:0@lo:13: 00000100:00100000:2.0:1787823471.087457:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823471.087593:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651831424 00000100:00100000:3.0:1787823471.087601:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651831424 00000100:00100000:3.0:1787823471.087669:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787823471.087680:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ac86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651831424:12345-0@lo:13: 00002000:00000024:3.0:1787823471.087715:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787823471.087780:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ac86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651831424:12345-0@lo:13: Request processed in 82us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823471.087787:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787823471.087824:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e792ec4fc00 x1874668651831424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823487 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823471.087844:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec4fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651831424:0@lo:13: 00000100:00080000:0.0:1787823471.087928:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787823471.850901:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823471.894847:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823471.894907:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823471.901006:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629788928 00000100:00100000:2.0:1787823471.901022:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629788928 00000100:00100000:2.0:1787823471.901118:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629789056 00000100:00100000:2.0:1787823471.901122:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629789056 00000100:00100000:2.0:1787823471.901157:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 5 00000100:00100000:2.0:1787823471.901167:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79262443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+7:0:x1874668629788928:12345-192.168.202.35@tcp:41: 00000004:00000024:2.0:1787823471.901209:0:5839:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787823471.901285:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79262443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+7:0:x1874668629788928:12345-192.168.202.35@tcp:41: Request processed in 119us (6448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823471.901292:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 5 00000100:00100000:2.0:1787823471.901310:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 6 00000100:00100000:2.0:1787823471.901316:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+6:5581:x1874668629789056:12345-192.168.202.35@tcp:41: 00000004:00000024:2.0:1787823471.901326:0:5839:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787823471.901345:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+6:5581:x1874668629789056:12345-192.168.202.35@tcp:41: Request processed in 30us (6441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823471.901351:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 6 00000100:00080000:0.0:1787823471.901603:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787823471.913665:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823471.913796:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629789184 00000100:00100000:2.0:1787823471.913807:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629789184 00000100:00100000:2.0:1787823471.913890:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 7 00000100:00100000:2.0:1787823471.913901:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790aef0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+6:5581:x1874668629789184:12345-192.168.202.35@tcp:40: 00000100:00100000:2.0:1787823471.914006:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790aef0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+6:5581:x1874668629789184:12345-192.168.202.35@tcp:40: Request processed in 107us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823471.914014:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 7 00000100:00100000:2.0:1787823471.918291:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823471.918355:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823471.918388:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823471.918428:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823471.918464:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629789312 00000100:00100000:0.0:1787823471.918468:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629789568 00000100:00100000:2.0:1787823471.918474:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629789312 00000100:00100000:0.0:1787823471.918476:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629789568 00000100:00100000:1.0:1787823471.918510:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629789440 00000100:00100000:1.0:1787823471.918514:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629789440 00000100:00100000:3.0:1787823471.918549:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629789696 00000100:00100000:1.0:1787823471.918550:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 128 00000100:00100000:3.0:1787823471.918553:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629789696 00000100:00100000:1.0:1787823471.918558:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+10:2352:x1874668629789440:12345-192.168.202.35@tcp:400: 00000100:00100000:3.0:1787823471.918578:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 0 00000100:00100000:3.0:1787823471.918584:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ac84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+6:5581:x1874668629789696:12345-192.168.202.35@tcp:33: 00000100:00100000:0.0:1787823471.918605:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 8 00000100:00100000:0.0:1787823471.918613:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792eb07840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1874668629789312:12345-192.168.202.35@tcp:8: 00000100:00100000:1.0:1787823471.918631:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+10:2352:x1874668629789440:12345-192.168.202.35@tcp:400: Request processed in 72us (350us total) trans 0 rc 0/0 00010000:00080000:0.0:1787823471.918640:0:6687:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from 353832f0-fe7b-4d99-975c-a8041babed42@192.168.202.35@tcp t0 exp 0000000000000000 cur 212 last 0 00000100:00100000:1.0:1787823471.918641:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 128 00000020:00000080:0.0:1787823471.918678:0:6687:0:(genops.c:1385:class_connect()) connect: client 353832f0-fe7b-4d99-975c-a8041babed42, cookie 0x5d1142b8324816c4 00002000:00100000:0.0:1787823471.918690:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 353832f0-fe7b-4d99-975c-a8041babed42/ffff8e792ee53800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787823471.918702:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787823471.919525:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787823471.919559:0:6687:0:(import.c:65:import_set_state_nolock()) ffff8e792ee51800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787823471.919951:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792eb07840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+6:2351:x1874668629789312:12345-192.168.202.35@tcp:8: Request processed in 1336us (1560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823471.919984:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 8 00000100:00100000:0.0:1787823471.920008:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00100000:0.0:1787823471.920013:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792eb04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1874668629789568:12345-192.168.202.35@tcp:8: 00010000:00080000:0.0:1787823471.920034:0:6687:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from 353832f0-fe7b-4d99-975c-a8041babed42@192.168.202.35@tcp t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:0.0:1787823471.920054:0:6687:0:(genops.c:1385:class_connect()) connect: client 353832f0-fe7b-4d99-975c-a8041babed42, cookie 0x5d1142b8324816cb 00002000:00100000:0.0:1787823471.920062:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 353832f0-fe7b-4d99-975c-a8041babed42/ffff8e792ee56800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787823471.920080:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787823471.920323:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787823471.920342:0:6687:0:(import.c:65:import_set_state_nolock()) ffff8e792ee56000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787823471.920379:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792eb04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+6:2351:x1874668629789568:12345-192.168.202.35@tcp:8: Request processed in 365us (1951us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823471.920386:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 9 00000004:00080000:3.0:1787823471.951613:0:5841:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 32955us 00000004:00200000:3.0:1787823471.978736:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787823471.985822:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ac84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+6:5581:x1874668629789696:12345-192.168.202.35@tcp:33: Request processed in 67226us (67455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823471.985841:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 0 00000100:00100000:2.0:1787823472.223412:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823472.223521:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629789824 00000100:00100000:1.0:1787823472.223531:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629789824 00000100:00100000:1.0:1787823472.223592:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 8 00000100:00100000:1.0:1787823472.223602:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792eb04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+6:5621:x1874668629789824:12345-192.168.202.35@tcp:101: 00010000:00010000:1.0:1787823472.223622:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823472.223702:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7901676400/0x5d1142b8324816d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44607 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823472.223824:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b8324816d9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823472.223840:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b8324816d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823472.223854:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b8324816d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787823472.224379:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787823472.224392:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787823472.224478:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b8324816d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823472.224507:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7901676400/0x5d1142b8324816d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44607 expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823472.224525:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b8324816d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44607 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823472.224535:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e7917859100) 00010000:00010000:1.0:1787823472.224537:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787823472.224540:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a2f2800, rc 0) 00000100:00100000:1.0:1787823472.224728:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792eb04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+7:5621:x1874668629789824:12345-192.168.202.35@tcp:101: Request processed in 1126us (1326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823472.224738:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 8 00010000:00010000:0.0:1787823472.874034:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823473.131599:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792eb06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874668651831808:0@lo:400: 00000100:00100000:0.0:1787823473.131688:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823473.131785:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787823473.131791:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7920d61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651831936:0@lo:400: 00000100:00100000:0.0:1787823473.131817:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823473.131851:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651831936 00000100:00100000:0.0:1787823473.131857:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651831936 00000100:00100000:0.0:1787823473.131925:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787823473.131934:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790aef30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651831936:12345-0@lo:400: 00000100:00100000:0.0:1787823473.131981:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790aef30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651831936:12345-0@lo:400: Request processed in 49us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823473.131989:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1787823473.132030:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787823473.132064:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7920d61e00 x1874668651831936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823473.132090:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7920d61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651831936:0@lo:400: 00000100:00100000:2.0:1787823473.132269:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651831808 00000100:00100000:2.0:1787823473.132274:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651831808 00000100:00100000:2.0:1787823473.132314:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787823473.132322:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790aef03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874668651831808:12345-0@lo:400: 00000100:00100000:2.0:1787823473.132361:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790aef03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874668651831808:12345-0@lo:400: Request processed in 41us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823473.132367:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1787823473.132430:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787823473.132451:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792eb06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874668651831808:0@lo:400: 00000100:00100000:3.0:1787823473.132676:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792eb07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651831552:0@lo:400: 00000100:00100000:3.0:1787823473.132719:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823473.132752:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7920d63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874668651832064:0@lo:400: 00000100:00100000:3.0:1787823473.132798:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823473.132825:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787823473.132832:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792eb05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874668651831680:0@lo:400: 00000100:00100000:3.0:1787823473.132854:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823473.132882:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651832192:0@lo:400: 00000100:00100000:3.0:1787823473.132903:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823473.133039:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651831552 00000100:00100000:0.0:1787823473.133044:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651831552 00000100:00100000:0.0:1787823473.133090:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787823473.133099:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3305:x1874668651831552:12345-0@lo:400: 00000100:00100000:0.0:1787823473.133138:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3305:x1874668651831552:12345-0@lo:400: Request processed in 41us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823473.133143:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787823473.133170:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651832192 00000100:00100000:0.0:1787823473.133173:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651832192 00000100:00100000:0.0:1787823473.133204:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787823473.133210:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651832192:12345-0@lo:400: 00000100:00100000:0.0:1787823473.133240:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651832192:12345-0@lo:400: Request processed in 31us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823473.133246:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1787823473.133261:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787823473.133440:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651832064 00000100:00100000:2.0:1787823473.133445:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651832064 00000100:00100000:2.0:1787823473.133487:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651831680 00000100:00100000:2.0:1787823473.133490:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651831680 00000100:00100000:2.0:1787823473.133510:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787823473.133516:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874668651832064:12345-0@lo:400: 00000100:00100000:2.0:1787823473.133552:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874668651832064:12345-0@lo:400: Request processed in 35us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823473.133558:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787823473.133572:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787823473.133578:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874668651831680:12345-0@lo:400: 00000100:00100000:2.0:1787823473.133620:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874668651831680:12345-0@lo:400: Request processed in 42us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823473.133636:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787823473.134337:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792eb05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874668651831680:0@lo:400: 00010000:00080000:3.0:1787823473.134353:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e793a4e8b40 x1874668651832192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823473.134363:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787823473.134377:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651832192:0@lo:400: 00000100:00100000:3.0:1787823473.134387:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792eb07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651831552:0@lo:400: 00000100:00100000:3.0:1787823473.134399:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7920d63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874668651832064:0@lo:400: 00000100:00080000:0.0:1787823473.135921:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787823473.645940:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7926245680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651832320:0@lo:13: 00000100:00100000:0.0:1787823473.646034:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823473.646323:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651832320 00000100:00100000:3.0:1787823473.646333:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651832320 00000100:00100000:3.0:1787823473.646409:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787823473.646419:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790aef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651832320:12345-0@lo:13: 00002000:00000024:3.0:1787823473.646458:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787823473.646508:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790aef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651832320:12345-0@lo:13: Request processed in 91us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823473.646516:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1787823473.651985:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7926245680 x1874668651832320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823489 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823473.652017:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7926245680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651832320:0@lo:13: 00010000:00010000:1.0:1787823473.898123:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823474.532439:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823474.532644:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629789952 00000100:00100000:2.0:1787823474.532655:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629789952 00000100:00100000:2.0:1787823474.532756:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00100000:2.0:1787823474.532797:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+7:5673:x1874668629789952:12345-192.168.202.35@tcp:41: 00000004:00000024:2.0:1787823474.532882:0:5840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787823474.533140:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+7:5673:x1874668629789952:12345-192.168.202.35@tcp:41: Request processed in 344us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823474.533148:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00080000:0.0:1787823474.533816:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787823474.538492:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823474.538538:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629790080 00000100:00100000:3.0:1787823474.538551:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629790080 00000100:00100000:3.0:1787823474.538613:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00080000:0.0:1787823474.538613:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787823474.538625:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790aef0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:353832f0-fe7b-4d99-975c-a8041babed42+6:5673:x1874668629790080:12345-192.168.202.35@tcp:13: 00002000:00000024:3.0:1787823474.538658:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787823474.538714:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790aef0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:353832f0-fe7b-4d99-975c-a8041babed42+6:5673:x1874668629790080:12345-192.168.202.35@tcp:13: Request processed in 92us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823474.538720:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00100000:3.0:1787823474.542304:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823474.542381:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629790208 00000100:00100000:1.0:1787823474.542390:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629790208 00000100:00080000:0.0:1787823474.542451:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787823474.542453:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 10 00000100:00100000:1.0:1787823474.542464:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:353832f0-fe7b-4d99-975c-a8041babed42+6:5673:x1874668629790208:12345-192.168.202.35@tcp:13: 00002000:00000024:1.0:1787823474.542489:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787823474.542547:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:353832f0-fe7b-4d99-975c-a8041babed42+6:5673:x1874668629790208:12345-192.168.202.35@tcp:13: Request processed in 86us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823474.542556:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 10 00010000:00010000:2.0:1787823474.922171:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787823475.267087:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 353832f0-fe7b-4d99-975c-a8041babed42 00000001:00100000:2.0:1787823475.794321:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 353832f0-fe7b-4d99-975c-a8041babed42 00010000:00010000:3.0:1787823475.956818:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787823476.202903:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790ae830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651832448:0@lo:13: 00000100:00100000:2.0:1787823476.203132:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823476.217660:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651832448 00000100:00100000:1.0:1787823476.217677:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651832448 00000100:00080000:0.0:1787823476.217714:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787823476.217749:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787823476.217783:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4e9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651832448:12345-0@lo:13: 00002000:00000024:1.0:1787823476.217829:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787823476.217946:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4e9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651832448:12345-0@lo:13: Request processed in 188us (14813us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823476.217953:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787823476.218029:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e790ae830c0 x1874668651832448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823492 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823476.218053:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790ae830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651832448:0@lo:13: 00000001:00100000:0.0:1787823476.284746:0:5860:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 353832f0-fe7b-4d99-975c-a8041babed42 00000100:00100000:0.0:1787823476.937631:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823476.937681:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823476.937749:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823476.937804:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823476.937884:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629790336 00000100:00100000:1.0:1787823476.937894:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629790336 00000100:00100000:1.0:1787823476.937953:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 130 00000100:00100000:1.0:1787823476.937965:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+10:2355:x1874668629790336:12345-192.168.202.35@tcp:400: 00000100:00100000:1.0:1787823476.938038:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+10:2355:x1874668629790336:12345-192.168.202.35@tcp:400: Request processed in 75us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823476.938046:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 130 00000100:00100000:1.0:1787823476.938914:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629790464 00000100:00100000:1.0:1787823476.938922:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629790464 00000100:00100000:1.0:1787823476.938977:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 25 00000100:00100000:1.0:1787823476.938986:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790aef3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+6:2355:x1874668629790464:12345-192.168.202.35@tcp:400: 00000100:00100000:1.0:1787823476.939041:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790aef3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+6:2355:x1874668629790464:12345-192.168.202.35@tcp:400: Request processed in 56us (1291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823476.939047:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 25 00000100:00080000:0.0:1787823476.939598:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787823476.940182:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629790592 00000100:00100000:2.0:1787823476.940190:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629790592 00000100:00100000:2.0:1787823476.940284:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629790720 00000100:00100000:2.0:1787823476.940288:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629790720 00000100:00100000:1.0:1787823476.940342:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00100000:1.0:1787823476.940353:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790aef3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+5:2355:x1874668629790592:12345-192.168.202.35@tcp:400: 00000100:00100000:1.0:1787823476.940409:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790aef3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+5:2355:x1874668629790592:12345-192.168.202.35@tcp:400: Request processed in 57us (2726us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823476.940415:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00080000:0.0:1787823476.940486:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787823476.940491:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787823476.940593:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 10 00000100:00100000:2.0:1787823476.940602:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790aef0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:353832f0-fe7b-4d99-975c-a8041babed42+5:2355:x1874668629790720:12345-192.168.202.35@tcp:400: 00000100:00100000:2.0:1787823476.940640:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790aef0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:353832f0-fe7b-4d99-975c-a8041babed42+5:2355:x1874668629790720:12345-192.168.202.35@tcp:400: Request processed in 40us (2836us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823476.940647:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 10 00010000:00010000:2.0:1787823476.976444:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787823477.362045:0:8302:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787823477.994120:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823478.252369:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792eb06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874668651832704:0@lo:400: 00000100:00100000:0.0:1787823478.252448:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823478.252504:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793516a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651833216:0@lo:400: 00000100:00100000:0.0:1787823478.252532:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823478.252564:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787823478.252570:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792eb05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651832576:0@lo:400: 00000100:00100000:0.0:1787823478.252599:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823478.252621:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7935169a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874668651833088:0@lo:400: 00000100:00100000:0.0:1787823478.252641:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823478.252669:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7920d63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874668651832832:0@lo:400: 00000100:00100000:0.0:1787823478.252708:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823478.252731:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787823478.252737:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7920d61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651832960:0@lo:400: 00000100:00100000:0.0:1787823478.252903:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823478.252942:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651832704 00000100:00100000:0.0:1787823478.252950:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651832704 00000100:00100000:0.0:1787823478.252992:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651833088 00000100:00100000:0.0:1787823478.252996:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651833088 00000100:00100000:0.0:1787823478.253017:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651832832 00000100:00100000:0.0:1787823478.253020:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651832832 00000100:00100000:0.0:1787823478.253036:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787823478.253045:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79351683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874668651832704:12345-0@lo:400: 00000100:00100000:0.0:1787823478.253098:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79351683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874668651832704:12345-0@lo:400: Request processed in 54us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823478.253106:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787823478.253122:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787823478.253128:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793516ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874668651833088:12345-0@lo:400: 00000100:00100000:0.0:1787823478.253158:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793516ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874668651833088:12345-0@lo:400: Request processed in 30us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823478.253164:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787823478.253175:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787823478.253182:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7935168b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874668651832832:12345-0@lo:400: 00000100:00100000:0.0:1787823478.253212:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7935168b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874668651832832:12345-0@lo:400: Request processed in 31us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823478.253218:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787823478.253235:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651833216 00000100:00100000:0.0:1787823478.253239:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651833216 00000100:00100000:0.0:1787823478.253265:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651832960 00000100:00100000:0.0:1787823478.253274:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651832960 00000100:00100000:0.0:1787823478.253293:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787823478.253299:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79351692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651833216:12345-0@lo:400: 00000100:00100000:0.0:1787823478.253332:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79351692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651833216:12345-0@lo:400: Request processed in 33us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823478.253338:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787823478.253348:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787823478.253354:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793516a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651832960:12345-0@lo:400: 00000100:00100000:0.0:1787823478.253380:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793516a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651832960:12345-0@lo:400: Request processed in 26us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823478.253385:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787823478.253401:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651832576 00000100:00100000:0.0:1787823478.253405:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651832576 00000100:00100000:0.0:1787823478.253429:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787823478.253436:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3306:x1874668651832576:12345-0@lo:400: 00000100:00100000:0.0:1787823478.253464:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3306:x1874668651832576:12345-0@lo:400: Request processed in 29us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823478.253470:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:0.0:1787823478.253503:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787823478.253507:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787823478.253510:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787823478.253543:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7920d61e00 x1874668651832960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823494 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823478.253558:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7920d61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651832960:0@lo:400: 00000100:00100000:0.0:1787823478.253570:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7920d63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874668651832832:0@lo:400: 00000100:00100000:0.0:1787823478.253601:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792eb05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651832576:0@lo:400: 00000100:00100000:0.0:1787823478.253622:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7935169a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874668651833088:0@lo:400: 00000100:00100000:0.0:1787823478.253630:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792eb06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874668651832704:0@lo:400: 00010000:00080000:0.0:1787823478.253639:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e793516a940 x1874668651833216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823494 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823478.253648:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793516a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651833216:0@lo:400: 00000100:00100000:1.0:1787823478.766279:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7926247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651833344:0@lo:13: 00000100:00100000:1.0:1787823478.766365:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823478.766447:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651833344 00000100:00100000:1.0:1787823478.766456:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651833344 00000100:00100000:1.0:1787823478.766954:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787823478.766978:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926244f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651833344:12345-0@lo:13: 00002000:00000024:1.0:1787823478.767017:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787823478.767075:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926244f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651833344:12345-0@lo:13: Request processed in 112us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823478.767083:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1787823478.767233:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7926247480 x1874668651833344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823494 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823478.767253:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7926247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651833344:0@lo:13: 00010000:00010000:3.0:1787823479.022924:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823480.044531:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787823480.961094:0:8452:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffca883820 20000000:00000080:1.0:1787823480.961191:0:8452:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e79399b8c00 uarg=0000000000000000 20000000:01000000:1.0:1787823480.961297:0:8452:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1787823480.961300:0:8452:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1787823480.961303:0:8452:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787823480.961309:0:8452:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787823480.961314:0:8452:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1787823480.961332:0:8452:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787823480.961335:0:8452:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787823480.961634:0:8452:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787823480.961637:0:8452:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787823480.964320:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1787823480.965463:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1787823480.965609:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1787823480.965677:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1787823480.965695:0:8452:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787823480.965698:0:8452:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787823480.969664:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1787823480.970318:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1787823480.970390:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1787823480.970427:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1787823480.970442:0:8452:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787823480.970445:0:8452:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787823480.971930:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1787823480.972642:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1787823480.972716:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1787823480.972917:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:0.0:1787823480.973070:0:8452:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787823480.973073:0:8452:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787823480.974355:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1787823480.975111:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1787823480.975317:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1787823480.975356:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:0.0:1787823480.975376:0:8452:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787823480.975399:0:8452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e7900030200/0x5d1142b8324816e0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823480.975418:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e79013a3000/0x5d1142b8324815dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b8324815d6 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823480.975424:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7900031000/0x5d1142b832481607 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832481600 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823480.975431:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e79013a2800/0x5d1142b832481631 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b83248162a expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823480.975437:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7901676600/0x5d1142b83248163f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832481638 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823480.975454:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7901677000/0x5d1142b83248164d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832481646 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823480.975460:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7901676a00/0x5d1142b832481669 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832481662 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823480.975467:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e79358d3c00/0x5d1142b832481693 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b83248168c expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823480.975477:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7900030000/0x5d1142b8324816a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f445a5 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823480.975485:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7901677600/0x5d1142b8324816a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f445ac expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823480.975493:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e7900030200/0x5d1142b8324816e0 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823480.975607:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7901677600/0x5d1142b8324816a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f445ac expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823480.975623:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e7901677600/0x5d1142b8324816a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f445ac expref: 9 pid: 5833 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823480.975637:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7935169680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874668651833472:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787823480.975906:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7900030000/0x5d1142b8324816a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f445a5 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823480.975916:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e7900030000/0x5d1142b8324816a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f445a5 expref: 9 pid: 5832 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823480.975932:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7935168780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874668651833600:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787823480.975980:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e79358d3c00/0x5d1142b832481693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d1142b83248168c expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823480.975988:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e79358d3c00/0x5d1142b832481693 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d1142b83248168c expref: 18 pid: 5831 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823480.975997:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793516b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874668651833728:0@lo:104: 00000100:00100000:0.0:1787823480.976038:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787823480.976115:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7901676a00/0x5d1142b832481669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d1142b832481662 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823480.976134:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7901676a00/0x5d1142b832481669 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d1142b832481662 expref: 18 pid: 5831 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823480.976143:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793516b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874668651833856:0@lo:104: 00000100:00100000:0.0:1787823480.976167:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787823480.980607:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7901677000/0x5d1142b83248164d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d1142b832481646 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823480.980630:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7901677000/0x5d1142b83248164d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d1142b832481646 expref: 18 pid: 5832 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823480.980646:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7935169e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874668651833984:0@lo:104: 00010000:00010000:0.0:1787823480.980709:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7901676600/0x5d1142b83248163f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d1142b832481638 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823480.980717:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7901676600/0x5d1142b83248163f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d1142b832481638 expref: 18 pid: 5831 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823480.980745:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793516bc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874668651834112:0@lo:104: 00010000:00010000:0.0:1787823480.980812:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e79013a2800/0x5d1142b832481631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d1142b83248162a expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823480.980821:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e79013a2800/0x5d1142b832481631 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d1142b83248162a expref: 18 pid: 5833 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823480.980830:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793516b840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874668651834240:0@lo:104: 00010000:00010000:0.0:1787823480.980855:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7900031000/0x5d1142b832481607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d1142b832481600 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823480.980863:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7900031000/0x5d1142b832481607 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d1142b832481600 expref: 18 pid: 5831 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823480.980870:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793516a1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874668651834368:0@lo:104: 00010000:00010000:0.0:1787823480.980897:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e79013a3000/0x5d1142b8324815dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d1142b8324815d6 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823480.980905:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e79013a3000/0x5d1142b8324815dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d1142b8324815d6 expref: 18 pid: 5832 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823480.980913:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793516a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874668651834496:0@lo:104: 00000100:00100000:0.0:1787823480.980930:0:8452:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79035b59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787823480.981467:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787823480.981501:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823480.981530:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823480.981540:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823480.981549:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823480.981557:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823480.981569:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651833728 00000100:00100000:3.0:1787823480.981576:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651833728 00000100:00100000:3.0:1787823480.981614:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651833856 00000100:00100000:3.0:1787823480.981617:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651833856 00000100:00100000:3.0:1787823480.981626:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651833984 00000100:00100000:3.0:1787823480.981628:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651833984 00000100:00100000:3.0:1787823480.981638:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651834112 00000100:00100000:3.0:1787823480.981640:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651834112 00000100:00100000:3.0:1787823480.981649:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651834240 00000100:00100000:3.0:1787823480.981652:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651834240 00000100:00100000:3.0:1787823480.981674:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651834368 00000100:00100000:3.0:1787823480.981676:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651834368 00000100:00100000:3.0:1787823480.981684:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651834496 00000100:00100000:3.0:1787823480.981687:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651834496 00000100:00100000:3.0:1787823480.981699:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787823480.981708:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7935168f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+9:8452:x1874668651833728:12345-0@lo:104: 00010000:00010000:3.0:1787823480.981722:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b83248168c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b832481693 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.981868:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787823480.981874:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7935168f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+9:8452:x1874668651833728:12345-0@lo:104: Request processed in 168us (5836us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823480.981882:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787823480.981901:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787823480.981908:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a45d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+8:8452:x1874668651833856:12345-0@lo:104: 00010000:00010000:3.0:1787823480.981916:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff8e7901676c00/0x5d1142b832481662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b832481669 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.981974:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787823480.981980:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a45d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+8:8452:x1874668651833856:12345-0@lo:104: Request processed in 73us (5812us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823480.981986:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787823480.982022:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787823480.982028:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790ae830c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+7:8452:x1874668651833984:12345-0@lo:104: 00010000:00010000:3.0:1787823480.982036:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff8e7920eeb800/0x5d1142b832481646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b83248164d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.982069:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787823480.982080:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790ae830c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+7:8452:x1874668651833984:12345-0@lo:104: Request processed in 52us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823480.982086:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787823480.982099:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787823480.982104:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ad52940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+6:8452:x1874668651834112:12345-0@lo:104: 00010000:00010000:3.0:1787823480.982111:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff8e79013a3800/0x5d1142b832481638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b83248163f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.982365:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787823480.982371:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ad52940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+6:8452:x1874668651834112:12345-0@lo:104: Request processed in 267us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823480.982377:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787823480.982392:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787823480.982398:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ad50b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+5:8452:x1874668651834240:12345-0@lo:104: 00010000:00010000:3.0:1787823480.982406:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff8e7900030400/0x5d1142b83248162a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b832481631 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.982431:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1787823480.982436:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ad50b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+5:8452:x1874668651834240:12345-0@lo:104: Request processed in 40us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823480.982442:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787823480.982453:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787823480.982458:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ad50780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+4:8452:x1874668651834368:12345-0@lo:104: 00010000:00010000:3.0:1787823480.982466:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff8e7920eea600/0x5d1142b832481600 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b832481607 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.982490:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1787823480.982501:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ad50780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+4:8452:x1874668651834368:12345-0@lo:104: Request processed in 43us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823480.982507:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787823480.982519:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787823480.982585:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ad512c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+3:8452:x1874668651834496:12345-0@lo:104: 00010000:00010000:3.0:1787823480.982594:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff8e7900031800/0x5d1142b8324815d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b8324815dd expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.982623:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1787823480.982628:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ad512c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+3:8452:x1874668651834496:12345-0@lo:104: Request processed in 104us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823480.982634:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1787823480.982655:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1787823480.982662:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b83248168c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b832481693 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.982670:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eea800 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:3.0:1787823480.982674:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b83248168c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d1142b832481693 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.982683:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b83248168c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d1142b832481693 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787823480.982691:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b83248168c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d1142b832481693 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787823480.982697:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787823480.982736:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b83248168c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832481693 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.982753:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787823480.982813:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b83248168c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832481693 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.982822:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b83248168c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832481693 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.982837:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1787823480.982841:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e7901676c00/0x5d1142b832481662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b832481669 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.982847:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7901676c00 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:3.0:1787823480.982849:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e7901676c00/0x5d1142b832481662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d1142b832481669 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.982856:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e7901676c00/0x5d1142b832481662 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d1142b832481669 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787823480.982862:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e7901676c00/0x5d1142b832481662 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d1142b832481669 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787823480.982867:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787823480.982882:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e7901676c00/0x5d1142b832481662 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832481669 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.982887:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787823480.982901:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e7901676c00/0x5d1142b832481662 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832481669 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.982908:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e7901676c00/0x5d1142b832481662 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832481669 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.982924:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787823480.982927:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e7920eeb800/0x5d1142b832481646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b83248164d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.982932:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eeb800 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:3.0:1787823480.982935:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e7920eeb800/0x5d1142b832481646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d1142b83248164d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823480.983043:0:7630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787823480.983050:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e79013a3800/0x5d1142b832481638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b83248163f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823480.983057:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79013a3800 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:2.0:1787823480.983059:0:7630:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e79013a3800/0x5d1142b832481638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d1142b83248163f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823480.983067:0:7630:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e79013a3800/0x5d1142b832481638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d1142b83248163f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787823480.983073:0:7630:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e79013a3800/0x5d1142b832481638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d1142b83248163f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787823480.983079:0:7630:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787823480.983096:0:7630:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e79013a3800/0x5d1142b832481638 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b83248163f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823480.983102:0:7630:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787823480.983108:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e79013a3800/0x5d1142b832481638 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b83248163f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823480.983114:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e79013a3800/0x5d1142b832481638 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b83248163f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823480.983138:0:7630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787823480.983141:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e7900030400/0x5d1142b83248162a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b832481631 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823480.983153:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7900030400 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:2.0:1787823480.983156:0:7630:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e7900030400/0x5d1142b83248162a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d1142b832481631 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823480.983163:0:7630:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e7900030400/0x5d1142b83248162a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d1142b832481631 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787823480.983169:0:7630:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e7900030400/0x5d1142b83248162a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d1142b832481631 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787823480.983174:0:7630:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787823480.983190:0:7630:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e7900030400/0x5d1142b83248162a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832481631 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823480.983196:0:7630:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787823480.983202:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e7900030400/0x5d1142b83248162a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832481631 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823480.983209:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e7900030400/0x5d1142b83248162a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832481631 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823480.983218:0:7630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787823480.983221:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e7920eea600/0x5d1142b832481600 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b832481607 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823480.983239:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eea600 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:2.0:1787823480.983242:0:7630:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e7920eea600/0x5d1142b832481600 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d1142b832481607 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823480.983259:0:7630:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e7920eea600/0x5d1142b832481600 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d1142b832481607 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787823480.983266:0:7630:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e7920eea600/0x5d1142b832481600 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d1142b832481607 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787823480.983272:0:7630:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787823480.983285:0:7630:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e7920eea600/0x5d1142b832481600 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832481607 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823480.983290:0:7630:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787823480.983295:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e7920eea600/0x5d1142b832481600 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832481607 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823480.983301:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e7920eea600/0x5d1142b832481600 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832481607 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823480.983310:0:7630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787823480.983313:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e7900031800/0x5d1142b8324815d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b8324815dd expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823480.983319:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7900031800 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:2.0:1787823480.983321:0:7630:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e7900031800/0x5d1142b8324815d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d1142b8324815dd expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823480.983328:0:7630:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e7900031800/0x5d1142b8324815d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d1142b8324815dd expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787823480.983335:0:7630:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e7900031800/0x5d1142b8324815d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d1142b8324815dd expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787823480.983345:0:7630:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787823480.983357:0:7630:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e7900031800/0x5d1142b8324815d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b8324815dd expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823480.983363:0:7630:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787823480.983366:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e7900031800/0x5d1142b8324815d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b8324815dd expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823480.983373:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e7900031800/0x5d1142b8324815d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b8324815dd expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823480.983383:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823480.983385:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823480.983386:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823480.984696:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e7920eeb800/0x5d1142b832481646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d1142b83248164d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787823480.984709:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e7920eeb800/0x5d1142b832481646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d1142b83248164d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787823480.984715:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787823480.984752:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e7920eeb800/0x5d1142b832481646 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b83248164d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.984773:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787823480.984782:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e7920eeb800/0x5d1142b832481646 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b83248164d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.984789:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e7920eeb800/0x5d1142b832481646 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b83248164d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.984821:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823480.984823:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823480.984826:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823480.984840:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823480.984857:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823480.984887:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ad50f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3308:1874668651834624:0@lo:103: 00000100:00100000:2.0:1787823480.985068:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ad53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651834752:0@lo:103: 00000100:00100000:2.0:1787823480.985103:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823480.985163:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651835264:0@lo:103: 00000100:00100000:2.0:1787823480.985184:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823480.985208:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787823480.985216:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651834880:0@lo:103: 00000100:00100000:2.0:1787823480.985361:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823480.985382:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ad52580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651835392:0@lo:103: 00000100:00100000:2.0:1787823480.985403:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823480.985440:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651835008:0@lo:103: 00000100:00100000:2.0:1787823480.985462:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823480.985488:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651834752 00000100:00100000:2.0:1787823480.985502:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651834752 00010000:00010000:2.0:1787823480.985606:0:7631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7901676a00/0x5d1142b832481669 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b832481662 expref: 19 pid: 5831 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823480.985628:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651835264 00000100:00100000:2.0:1787823480.985632:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651835264 00010000:00010000:2.0:1787823480.985644:0:7631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e79013a3000/0x5d1142b8324815dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b8324815d6 expref: 20 pid: 5832 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823480.985654:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651834880 00000100:00100000:2.0:1787823480.985656:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651834880 00010000:00010000:2.0:1787823480.985666:0:7631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7901676600/0x5d1142b83248163f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b832481638 expref: 21 pid: 5831 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823480.985676:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651835392 00000100:00100000:2.0:1787823480.985678:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651835392 00010000:00010000:2.0:1787823480.985688:0:7631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7901677000/0x5d1142b83248164d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b832481646 expref: 22 pid: 5832 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823480.985698:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651835008 00000100:00100000:2.0:1787823480.985701:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651835008 00010000:00010000:2.0:1787823480.985711:0:7631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e79013a2800/0x5d1142b832481631 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b83248162a expref: 23 pid: 5833 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823480.985724:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787823480.985732:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+23:3305:x1874668651834752:12345-0@lo:103: 00010000:00010000:2.0:1787823480.985745:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787823480.985750:0:7631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7901676a00/0x5d1142b832481669 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b832481662 expref: 23 pid: 5831 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823480.985783:0:7631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7901676a00/0x5d1142b832481669 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d1142b832481662 expref: 23 pid: 5831 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823480.985826:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787823480.985863:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+23:3305:x1874668651834752:12345-0@lo:103: Request processed in 131us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823480.985870:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787823480.985889:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787823480.985895:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4eb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+22:3305:x1874668651835264:12345-0@lo:103: 00010000:00010000:2.0:1787823480.985903:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787823480.985907:0:7631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e79013a3000/0x5d1142b8324815dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b8324815d6 expref: 22 pid: 5832 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823480.985914:0:7631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e79013a3000/0x5d1142b8324815dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d1142b8324815d6 expref: 22 pid: 5832 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823480.985924:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787823480.986845:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4eb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+22:3305:x1874668651835264:12345-0@lo:103: Request processed in 944us (1654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823480.986855:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787823480.986876:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787823480.986884:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+21:3305:x1874668651834880:12345-0@lo:103: 00010000:00010000:2.0:1787823480.986895:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787823480.986901:0:7631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7901676600/0x5d1142b83248163f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b832481638 expref: 21 pid: 5831 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823480.986911:0:7631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7901676600/0x5d1142b83248163f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d1142b832481638 expref: 21 pid: 5831 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823480.986925:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787823480.987012:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823480.987047:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3308:1874668651835136:0@lo:103: 00000100:00100000:3.0:1787823480.987086:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823480.987290:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:2.0:1787823480.987389:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+21:3305:x1874668651834880:12345-0@lo:103: Request processed in 507us (2027us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823480.987397:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787823480.987414:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651834624 00000100:00100000:2.0:1787823480.987419:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651834624 00010000:00010000:2.0:1787823480.987437:0:7631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e79358d3c00/0x5d1142b832481693 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b83248168c expref: 21 pid: 5831 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823480.987449:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651835136 00000100:00100000:2.0:1787823480.987452:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651835136 00010000:00010000:2.0:1787823480.987461:0:7631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7900031000/0x5d1142b832481607 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b832481600 expref: 22 pid: 5831 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823480.987471:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787823480.987477:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+22:3305:x1874668651835392:12345-0@lo:103: 00010000:00010000:2.0:1787823480.987485:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787823480.987490:0:7631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7901677000/0x5d1142b83248164d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b832481646 expref: 22 pid: 5832 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823480.987499:0:7631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7901677000/0x5d1142b83248164d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d1142b832481646 expref: 22 pid: 5832 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823480.987511:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787823480.987595:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787823480.987605:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4ea940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+22:3307:x1874668651835008:12345-0@lo:103: 00010000:00010000:3.0:1787823480.987614:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787823480.987619:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e79013a2800/0x5d1142b832481631 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b83248162a expref: 22 pid: 5833 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.987629:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e79013a2800/0x5d1142b832481631 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d1142b83248162a expref: 22 pid: 5833 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.987638:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787823480.987716:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793516b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874668651833728:0@lo:104: 00000100:00100000:0.0:1787823480.987733:0:5823:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1787823480.987741:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:0.0:1787823480.987795:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7901676a00/0x5d1142b832481669 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d1142b832481662 expref: 22 pid: 5831 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823480.987829:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793516b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874668651833856:0@lo:104: 00010000:00010000:0.0:1787823480.987842:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7901677000/0x5d1142b83248164d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d1142b832481646 expref: 21 pid: 5832 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823480.987851:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7935169e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874668651833984:0@lo:104: 00010000:00010000:0.0:1787823480.987860:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7901676600/0x5d1142b83248163f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d1142b832481638 expref: 20 pid: 5831 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823480.987868:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793516bc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874668651834112:0@lo:104: 00010000:00010000:0.0:1787823480.987877:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e79013a2800/0x5d1142b832481631 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d1142b83248162a expref: 19 pid: 5833 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823480.987884:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793516b840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874668651834240:0@lo:104: 00000100:00100000:0.0:1787823480.987893:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793516a1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874668651834368:0@lo:104: 00010000:00010000:0.0:1787823480.987901:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e79013a3000/0x5d1142b8324815dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d1142b8324815d6 expref: 18 pid: 5832 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823480.987911:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793516a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874668651834496:0@lo:104: 00000100:00100000:3.0:1787823480.988537:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4ea940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:3307:x1874668651835008:12345-0@lo:103: Request processed in 932us (3071us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823480.988546:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787823480.988567:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787823480.988575:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+16:3308:x1874668651834624:12345-0@lo:103: 00010000:00010000:3.0:1787823480.988585:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787823480.988603:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e79358d3c00/0x5d1142b832481693 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b83248168c expref: 16 pid: 5831 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.988614:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e79358d3c00/0x5d1142b832481693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d1142b83248168c expref: 16 pid: 5831 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.988626:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e79358d3c00/0x5d1142b832481693 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d1142b83248168c expref: 16 pid: 5831 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.988643:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787823480.988677:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+15:3308:x1874668651834624:12345-0@lo:103: Request processed in 104us (1665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823480.988683:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787823480.988700:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787823480.988706:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909a20850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:3308:x1874668651835136:12345-0@lo:103: 00010000:00010000:3.0:1787823480.988714:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787823480.988719:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7900031000/0x5d1142b832481607 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b832481600 expref: 14 pid: 5831 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.988727:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7900031000/0x5d1142b832481607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d1142b832481600 expref: 14 pid: 5831 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.988736:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7900031000/0x5d1142b832481607 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d1142b832481600 expref: 14 pid: 5831 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.988745:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787823480.988790:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909a20850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:3308:x1874668651835136:12345-0@lo:103: Request processed in 84us (1703us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823480.988806:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787823480.988914:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823480.988956:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823480.988986:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ad50f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3308:1874668651834624:0@lo:103: 00000100:00100000:3.0:1787823480.988996:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3308:1874668651835136:0@lo:103: 00000100:00100000:3.0:1787823480.989026:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629790848 00000100:00100000:3.0:1787823480.989030:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629790848 00010000:00010000:3.0:1787823480.989056:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7901677600/0x5d1142b8324816a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f445ac expref: 10 pid: 5833 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823480.989071:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629790976 00000100:00100000:3.0:1787823480.989073:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629790976 00010000:00010000:3.0:1787823480.989084:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7900030000/0x5d1142b8324816a1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f445a5 expref: 11 pid: 5832 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823480.989096:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 19 00000100:00100000:3.0:1787823480.989102:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922b8a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29690577-71bc-48f4-b24d-bdb875faaf85+11:2353:x1874668629790848:12345-192.168.202.35@tcp:103: 00010000:00010000:3.0:1787823480.989109:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787823480.989113:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7901677600/0x5d1142b8324816a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f445ac expref: 11 pid: 5833 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.989624:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7901677600/0x5d1142b8324816a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f445ac expref: 11 pid: 5833 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.989639:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787823480.989682:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922b8a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29690577-71bc-48f4-b24d-bdb875faaf85+11:2353:x1874668629790848:12345-192.168.202.35@tcp:103: Request processed in 580us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823480.989689:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 19 00000100:00100000:3.0:1787823480.989706:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 20 00000100:00100000:3.0:1787823480.989714:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922b883c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29690577-71bc-48f4-b24d-bdb875faaf85+10:2353:x1874668629790976:12345-192.168.202.35@tcp:103: 00010000:00010000:3.0:1787823480.989723:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787823480.989728:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7900030000/0x5d1142b8324816a1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f445a5 expref: 10 pid: 5832 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.989737:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7900030000/0x5d1142b8324816a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f445a5 expref: 10 pid: 5832 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.989787:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e7900030200/0x5d1142b8324816e0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.989806:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7900030200/0x5d1142b8324816e0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.989822:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7900030200/0x5d1142b8324816e0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.989829:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7900030200/0x5d1142b8324816e0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.989836:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e7900030200/0x5d1142b8324816e0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.989842:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e7900030200/0x5d1142b8324816e0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.989849:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7900030200 already unused, calling callback (ffffffffc1649440) 00010000:00010000:3.0:1787823480.989853:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e7900030200/0x5d1142b8324816e0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.989861:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e7900030200/0x5d1142b8324816e0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.989871:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e7900030200/0x5d1142b8324816e0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.989881:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787823480.989902:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922b883c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29690577-71bc-48f4-b24d-bdb875faaf85+10:2353:x1874668629790976:12345-192.168.202.35@tcp:103: Request processed in 190us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823480.989918:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 20 00010000:00010000:3.0:1787823480.990755:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7901677600/0x5d1142b8324816a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f445ac expref: 9 pid: 5833 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823480.990814:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7935169680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874668651833472:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787823480.990830:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7900030000/0x5d1142b8324816a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f445a5 expref: 8 pid: 5832 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823480.990840:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7935168780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874668651833600:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787823480.990886:0:8452:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e7900030200/0x5d1142b8324816e0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.990898:0:8452:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e7900030200/0x5d1142b8324816e0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.990903:0:8452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e7900030200/0x5d1142b8324816e0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823480.990909:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7900030200/0x5d1142b8324816e0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823480.992109:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:3305:x1874668651835392:12345-0@lo:103: Request processed in 4624us (6697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823480.992134:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787823480.992214:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651834880:0@lo:103: 00000100:00100000:2.0:1787823480.992582:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ad52580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651835392:0@lo:103: 00000100:00100000:2.0:1787823480.992597:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ad53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651834752:0@lo:103: 00000100:00100000:2.0:1787823480.992613:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651835264:0@lo:103: 00000100:00100000:1.0:1787823480.993514:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651835008:0@lo:103: 00010000:00010000:2.0:1787823481.065960:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787823481.324336:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651835520:0@lo:13: 00000100:00100000:2.0:1787823481.324413:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823481.324485:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651835520 00000100:00100000:2.0:1787823481.324493:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651835520 00000100:00100000:2.0:1787823481.324549:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787823481.324558:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651835520:12345-0@lo:13: 00002000:00000024:2.0:1787823481.324590:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787823481.324630:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651835520:12345-0@lo:13: Request processed in 73us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823481.324637:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1787823481.324677:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e793a4e9e00 x1874668651835520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823497 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823481.324695:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651835520:0@lo:13: 00000100:00080000:3.0:1787823481.326880:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787823482.053483:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823482.053528:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823482.053567:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823482.053623:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823482.053699:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629791360 00000100:00100000:3.0:1787823482.053709:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629791360 00000100:00100000:1.0:1787823482.053838:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629791232 00000100:00100000:1.0:1787823482.053843:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629791232 00000100:00100000:0.0:1787823482.053881:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629791104 00000100:00100000:0.0:1787823482.053886:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629791104 00000100:00100000:0.0:1787823482.053947:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 132 00000100:00100000:0.0:1787823482.053959:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+8:2355:x1874668629791104:12345-192.168.202.35@tcp:400: 00000100:00100000:0.0:1787823482.054052:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+8:2355:x1874668629791104:12345-192.168.202.35@tcp:400: Request processed in 96us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823482.054061:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 132 00000100:00100000:0.0:1787823482.054112:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629791488 00000100:00100000:0.0:1787823482.054115:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629791488 00000100:00100000:3.0:1787823482.054187:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 13 00000100:00100000:3.0:1787823482.054196:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:353832f0-fe7b-4d99-975c-a8041babed42+5:2355:x1874668629791360:12345-192.168.202.35@tcp:400: 00000100:00100000:3.0:1787823482.054227:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:353832f0-fe7b-4d99-975c-a8041babed42+5:2355:x1874668629791360:12345-192.168.202.35@tcp:400: Request processed in 33us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823482.054243:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 13 00000100:00080000:2.0:1787823482.066868:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787823482.066881:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787823482.066884:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787823482.069125:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 29 00000100:00100000:1.0:1787823482.069144:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+6:2355:x1874668629791232:12345-192.168.202.35@tcp:400: 00000100:00100000:1.0:1787823482.069233:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+6:2355:x1874668629791232:12345-192.168.202.35@tcp:400: Request processed in 97us (15666us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823482.069241:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 29 00000100:00100000:0.0:1787823482.074610:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 14 00000100:00100000:0.0:1787823482.074630:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+5:2355:x1874668629791488:12345-192.168.202.35@tcp:400: 00000100:00100000:0.0:1787823482.074727:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+5:2355:x1874668629791488:12345-192.168.202.35@tcp:400: Request processed in 105us (21102us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823482.074735:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 14 00010000:00010000:3.0:1787823482.090265:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823482.502740:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823482.508282:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629791616 00000100:00100000:0.0:1787823482.508296:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629791616 00000100:00100000:0.0:1787823482.508374:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 133 00000100:00100000:0.0:1787823482.508396:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+8:5595:x1874668629791616:12345-192.168.202.35@tcp:101: 00010000:00010000:0.0:1787823482.508417:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823482.508442:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7900031800/0x5d1142b8324816e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe697ab316f4460e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823482.508478:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7900031800/0x5d1142b8324816e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4460e expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823482.508487:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7900031800/0x5d1142b8324816e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4460e expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823482.508505:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7900031800, rc 0) 00000100:00100000:0.0:1787823482.508573:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+9:5595:x1874668629791616:12345-192.168.202.35@tcp:101: Request processed in 180us (5844us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823482.508580:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 133 00000100:00100000:0.0:1787823482.528322:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823482.535858:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629791744 00000100:00100000:3.0:1787823482.537529:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629791744 00000100:00100000:3.0:1787823482.537633:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 134 00000100:00100000:3.0:1787823482.537645:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+9:5595:x1874668629791744:12345-192.168.202.35@tcp:501: 00000100:00100000:3.0:1787823482.538008:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+9:5595:x1874668629791744:12345-192.168.202.35@tcp:501: Request processed in 363us (9701us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823482.538018:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 134 00000100:00100000:1.0:1787823482.548209:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823482.548324:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629791872 00000100:00100000:0.0:1787823482.548334:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629791872 00000100:00100000:0.0:1787823482.548405:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 135 00000100:00100000:0.0:1787823482.548415:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+9:5595:x1874668629791872:12345-192.168.202.35@tcp:503: 00000100:00100000:0.0:1787823482.548678:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+9:5595:x1874668629791872:12345-192.168.202.35@tcp:503: Request processed in 263us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823482.548687:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 135 00000100:00100000:0.0:1787823482.555322:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823482.555439:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629792000 00000100:00100000:2.0:1787823482.555451:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629792000 00000100:00100000:2.0:1787823482.555520:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 136 00000100:00100000:2.0:1787823482.555530:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+9:6067:x1874668629792000:12345-192.168.202.35@tcp:502: 00000100:00100000:2.0:1787823482.556314:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+9:6067:x1874668629792000:12345-192.168.202.35@tcp:502: Request processed in 780us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823482.556323:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 136 00000100:00100000:2.0:1787823482.574453:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823482.574745:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629792128 00000100:00100000:3.0:1787823482.574818:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629792128 00000100:00100000:3.0:1787823482.574886:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 137 00000100:00100000:3.0:1787823482.574896:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+9:6067:x1874668629792128:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787823482.575215:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+9:6067:x1874668629792128:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 319us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823482.575223:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 137 00000100:00100000:1.0:1787823482.583259:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823482.583372:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629792256 00000100:00100000:2.0:1787823482.583383:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629792256 00000100:00100000:2.0:1787823482.583443:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 138 00000100:00100000:2.0:1787823482.583454:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+9:5595:x1874668629792256:12345-192.168.202.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787823482.583470:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823482.583489:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e79358d3600/0x5d1142b8324816ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44615 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823482.583519:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e79358d3600/0x5d1142b8324816ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44615 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823482.583532:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e79358d3600/0x5d1142b8324816ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44615 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823482.583541:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d3600, rc 0) 00000100:00100000:2.0:1787823482.583603:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+10:5595:x1874668629792256:12345-192.168.202.35@tcp:101:ll_cfg_requeue.0 Request processed in 151us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823482.583610:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 138 00000100:00100000:1.0:1787823482.589299:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823482.589417:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629792384 00000100:00100000:0.0:1787823482.589426:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629792384 00000100:00100000:0.0:1787823482.589532:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 139 00000100:00100000:0.0:1787823482.589543:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+10:5595:x1874668629792384:12345-192.168.202.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787823482.589919:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+10:5595:x1874668629792384:12345-192.168.202.35@tcp:501:ll_cfg_requeue.0 Request processed in 377us (632us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787823482.589928:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 139 10000000:01000000:3.0:1787823482.730736:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787823482.730747:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e7903710800 from 39 10000000:01000000:3.0:1787823482.730774:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787823482.730844:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7920eea200/0x5d1142b8324816f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823482.730857:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e7920eea200/0x5d1142b8324816f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823482.730868:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e7920eea200/0x5d1142b8324816f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823482.730907:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922b892c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651835648:0@lo:101: 00000100:00100000:3.0:1787823482.730987:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823482.731074:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908cbc480 going to sleep for 11 seconds 00000100:00100000:0.0:1787823482.731499:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651835648 00000100:00100000:0.0:1787823482.731520:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651835648 00000100:00100000:0.0:1787823482.731582:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787823482.731593:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+12:5835:x1874668651835648:12345-0@lo:101: 00010000:00010000:0.0:1787823482.731609:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823482.731624:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7900030800/0x5d1142b8324816fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b8324816f5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823482.731655:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7900030800/0x5d1142b8324816fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b8324816f5 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823482.731667:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7900030800/0x5d1142b8324816fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b8324816f5 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823482.731689:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7900030800, rc 0) 00000100:00100000:0.0:1787823482.731751:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:5835:x1874668651835648:12345-0@lo:101: Request processed in 159us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823482.731780:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787823482.732159:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922b892c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651835648:0@lo:101: 00010000:00010000:3.0:1787823482.732177:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e7920eea200/0x5d1142b8324816f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324816fc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823482.732186:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e7920eea200/0x5d1142b8324816f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b8324816fc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823482.732245:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922b892c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651835776:0@lo:501: 00000100:00100000:3.0:1787823482.732279:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823482.732314:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908cbc480 going to sleep for 11 seconds 00000100:00100000:0.0:1787823482.732410:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651835776 00000100:00100000:0.0:1787823482.732415:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651835776 00000100:00100000:0.0:1787823482.732450:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787823482.732457:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:5835:x1874668651835776:12345-0@lo:501: 00000100:00100000:0.0:1787823482.733050:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:5835:x1874668651835776:12345-0@lo:501: Request processed in 592us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823482.733059:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787823482.734166:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922b892c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651835776:0@lo:501: 00000100:00100000:3.0:1787823482.734215:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922b892c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651835904:0@lo:503: 00000100:00100000:3.0:1787823482.734268:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823482.734359:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908cbc480 going to sleep for 11 seconds 00000100:00100000:2.0:1787823482.736645:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651835904 00000100:00100000:2.0:1787823482.736660:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651835904 00000100:00100000:2.0:1787823482.736913:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787823482.736935:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:5835:x1874668651835904:12345-0@lo:503: 00000100:00100000:2.0:1787823482.737211:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:5835:x1874668651835904:12345-0@lo:503: Request processed in 287us (2941us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823482.737226:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787823482.737337:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922b892c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651835904:0@lo:503: 00000100:00100000:0.0:1787823482.739875:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7935169a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:8470:1874668651836032:0@lo:502: 00000100:00100000:0.0:1787823482.739997:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823482.740473:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79035b5000 going to sleep for 11 seconds 00000100:00100000:3.0:1787823482.745496:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651836032 00000100:00100000:3.0:1787823482.745524:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651836032 00000100:00100000:3.0:1787823482.745597:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787823482.745607:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:8470:x1874668651836032:12345-0@lo:502: 00000100:00100000:3.0:1787823482.746384:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:8470:x1874668651836032:12345-0@lo:502: Request processed in 775us (6393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823482.746395:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787823482.746708:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7935169a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:8470:1874668651836032:0@lo:502: 00000100:00100000:0.0:1787823482.746817:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7935169a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:8470:1874668651836160:0@lo:502: 00000100:00100000:0.0:1787823482.746869:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823482.746899:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79035b5000 going to sleep for 11 seconds 00000100:00100000:2.0:1787823482.747115:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651836160 00000100:00100000:2.0:1787823482.747121:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651836160 00000100:00100000:2.0:1787823482.747153:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787823482.747160:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:8470:x1874668651836160:12345-0@lo:502: 00000100:00100000:2.0:1787823482.747358:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:8470:x1874668651836160:12345-0@lo:502: Request processed in 197us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823482.747365:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787823482.748224:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7935169a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:8470:1874668651836160:0@lo:502: 00000040:00080000:0.0:1787823482.748262:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787823482.750062:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787823482.750102:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787823482.750115:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7920eea200/0x5d1142b8324816f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324816fc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823482.750128:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e7920eea200/0x5d1142b8324816f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324816fc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787823482.750138:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1787823482.750142:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1787823482.750144:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787823482.750191:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e79358d3e00/0x5d1142b832481703 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823482.750199:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e79358d3e00/0x5d1142b832481703 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823482.750211:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e79358d3e00/0x5d1142b832481703 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823482.750242:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4ea1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651836288:0@lo:101: 00000100:00100000:2.0:1787823482.750609:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823482.750661:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7909b75600 going to sleep for 11 seconds 00000100:00100000:0.0:1787823482.751116:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651836288 00000100:00100000:0.0:1787823482.751128:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651836288 00000100:00100000:0.0:1787823482.751197:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787823482.751219:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+13:5835:x1874668651836288:12345-0@lo:101: 00010000:00010000:0.0:1787823482.751241:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823482.751258:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7900031400/0x5d1142b83248170a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b832481703 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823482.751286:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7900031400/0x5d1142b83248170a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b832481703 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823482.751297:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7900031400/0x5d1142b83248170a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832481703 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823482.751306:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7900031400, rc 0) 00000100:00100000:0.0:1787823482.751359:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:5835:x1874668651836288:12345-0@lo:101: Request processed in 143us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823482.751367:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787823482.751401:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4ea1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651836288:0@lo:101: 00010000:00010000:2.0:1787823482.751418:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e79358d3e00/0x5d1142b832481703 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248170a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823482.751428:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e79358d3e00/0x5d1142b832481703 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b83248170a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823482.751729:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4ea1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651836416:0@lo:501: 00000100:00100000:2.0:1787823482.751807:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823482.751833:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7909b75600 going to sleep for 11 seconds 00000100:00100000:1.0:1787823482.751837:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651836416 00000100:00100000:1.0:1787823482.751842:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651836416 00000100:00100000:1.0:1787823482.751915:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787823482.751933:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:5835:x1874668651836416:12345-0@lo:501: 00000100:00100000:1.0:1787823482.752345:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:5835:x1874668651836416:12345-0@lo:501: Request processed in 422us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823482.752353:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787823482.755267:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4ea1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651836416:0@lo:501: 00000100:00100000:2.0:1787823482.755333:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4ea1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651836544:0@lo:503: 00000100:00100000:2.0:1787823482.755415:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823482.755468:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7909b75600 going to sleep for 11 seconds 00000100:00100000:0.0:1787823482.756130:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651836544 00000100:00100000:0.0:1787823482.756139:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651836544 00000100:00100000:0.0:1787823482.756241:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787823482.756253:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:5835:x1874668651836544:12345-0@lo:503: 00000100:00100000:0.0:1787823482.756515:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:5835:x1874668651836544:12345-0@lo:503: Request processed in 256us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823482.756523:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787823482.756626:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4ea1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651836544:0@lo:503: 00000100:00100000:2.0:1787823482.757380:0:8471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4ea1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:8471:1874668651836672:0@lo:502: 00000100:00100000:2.0:1787823482.757433:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823482.758048:0:8471:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7909b75540 going to sleep for 11 seconds 00000100:00100000:3.0:1787823482.758164:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651836672 00000100:00100000:3.0:1787823482.758183:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651836672 00000100:00100000:3.0:1787823482.758221:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787823482.758232:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:8471:x1874668651836672:12345-0@lo:502: 00000100:00100000:3.0:1787823482.758485:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:8471:x1874668651836672:12345-0@lo:502: Request processed in 254us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823482.758494:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787823482.758736:0:8471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4ea1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:8471:1874668651836672:0@lo:502: 00000020:01000000:2.0:1787823482.758889:0:8471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787823482.758900:0:8471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787823482.758902:0:8471:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787823482.758908:0:8471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787823482.759070:0:8471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4ea1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:8471:1874668651836800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787823482.759120:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823482.759152:0:8471:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7909b75540 going to sleep for 11 seconds 00000100:00100000:3.0:1787823482.759218:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651836800 00000100:00100000:3.0:1787823482.759224:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651836800 00000100:00100000:3.0:1787823482.759251:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787823482.759257:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:8471:x1874668651836800:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787823482.759885:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:8471:x1874668651836800:12345-0@lo:502:llog_process_th.0 Request processed in 624us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823482.759893:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787823482.760093:0:8471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4ea1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:8471:1874668651836800:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787823482.760120:0:8471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787823482.760125:0:8471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787823482.760127:0:8471:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787823482.760130:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1787823482.760636:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1787823482.760663:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787823482.761180:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e79358d3e00/0x5d1142b832481703 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248170a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823482.761192:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e79358d3e00/0x5d1142b832481703 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248170a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787823482.761202:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787823482.761205:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e7909bc2800 from 39 10000000:01000000:1.0:1787823482.761219:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787823482.761249:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a2f3800/0x5d1142b832481711 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823482.761258:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e793a2f3800/0x5d1142b832481711 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823482.761267:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e793a2f3800/0x5d1142b832481711 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823482.761288:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7926245e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651836928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787823482.761341:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823482.761380:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7907e18000 going to sleep for 11 seconds 00000100:00100000:3.0:1787823482.761483:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651836928 00000100:00100000:3.0:1787823482.761489:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651836928 00000100:00100000:3.0:1787823482.761598:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787823482.761608:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:5835:x1874668651836928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787823482.761620:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823482.761632:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7920eeb800/0x5d1142b832481718 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b832481711 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823482.761655:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7920eeb800/0x5d1142b832481718 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b832481711 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823482.761666:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7920eeb800/0x5d1142b832481718 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832481711 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823482.761675:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7920eeb800, rc 0) 00000100:00100000:3.0:1787823482.761719:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+15:5835:x1874668651836928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823482.761726:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787823482.762059:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7926245e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651836928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787823482.762072:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e793a2f3800/0x5d1142b832481711 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481718 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823482.762081:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e793a2f3800/0x5d1142b832481711 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b832481718 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823482.762132:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7926245e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651837056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787823482.762157:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823482.762215:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7907e18000 going to sleep for 11 seconds 00000100:00100000:0.0:1787823482.762249:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651837056 00000100:00100000:0.0:1787823482.762253:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651837056 00000100:00100000:0.0:1787823482.762280:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787823482.762287:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+15:5835:x1874668651837056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787823482.762651:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+15:5835:x1874668651837056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 363us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823482.762669:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787823482.762720:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7926245e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651837056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787823482.762748:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7926245e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651837184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787823482.763118:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823482.763179:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7907e18000 going to sleep for 11 seconds 00000100:00100000:0.0:1787823482.763224:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651837184 00000100:00100000:0.0:1787823482.763229:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651837184 00000100:00100000:0.0:1787823482.763301:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787823482.763308:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+15:5835:x1874668651837184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787823482.763476:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+15:5835:x1874668651837184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823482.763483:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787823482.763568:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7926245e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651837184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787823482.764195:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7926245e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:8472:1874668651837312:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787823482.764240:0:8472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823482.764413:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7907e18f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787823482.764469:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651837312 00000100:00100000:3.0:1787823482.764474:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651837312 00000100:00100000:3.0:1787823482.764501:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787823482.764579:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+15:8472:x1874668651837312:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787823482.764824:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+15:8472:x1874668651837312:12345-0@lo:502:llog_process_th.0 Request processed in 249us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823482.764831:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787823482.764973:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7926245e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:8472:1874668651837312:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787823482.765027:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7926245e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:8472:1874668651837440:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787823482.765060:0:8472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823482.765084:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7907e18f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787823482.765248:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651837440 00000100:00100000:3.0:1787823482.765252:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651837440 00000100:00100000:3.0:1787823482.765271:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787823482.765276:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+15:8472:x1874668651837440:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787823482.765421:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+15:8472:x1874668651837440:12345-0@lo:502:llog_process_th.0 Request processed in 143us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823482.765427:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787823482.765503:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7926245e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:8472:1874668651837440:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787823482.765587:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787823482.765754:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787823482.765919:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787823482.766067:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a2f3800/0x5d1142b832481711 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481718 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823482.766079:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e793a2f3800/0x5d1142b832481711 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481718 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787823482.766089:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787823482.766091:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1787823482.766094:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787823482.766127:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b83248171f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823482.766135:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b83248171f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823482.766145:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b83248171f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823482.766163:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922b8ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651837568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787823482.766196:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823482.766222:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908cbca80 going to sleep for 11 seconds 00000100:00100000:1.0:1787823482.766271:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651837568 00000100:00100000:1.0:1787823482.766276:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651837568 00000100:00100000:1.0:1787823482.766301:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787823482.766307:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+15:5835:x1874668651837568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787823482.766318:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823482.766331:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e793a2f3c00/0x5d1142b832481726 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b83248171f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823482.766355:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e793a2f3c00/0x5d1142b832481726 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b83248171f expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823482.766365:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e793a2f3c00/0x5d1142b832481726 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b83248171f expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823482.766373:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a2f3c00, rc 0) 00000100:00100000:1.0:1787823482.766412:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+16:5835:x1874668651837568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823482.766425:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787823482.766653:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922b8ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651837568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787823482.766667:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b83248171f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481726 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823482.766676:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b83248171f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b832481726 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823482.766719:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922b8ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651837696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787823482.766748:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823482.766905:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908cbca80 going to sleep for 11 seconds 00000100:00100000:1.0:1787823482.767082:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651837696 00000100:00100000:1.0:1787823482.767087:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651837696 00000100:00100000:1.0:1787823482.767122:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787823482.767129:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+16:5835:x1874668651837696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787823482.767402:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+16:5835:x1874668651837696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 273us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823482.767410:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787823482.767603:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922b8ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651837696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787823482.767639:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922b8ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651837824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787823482.767687:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823482.767711:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908cbca80 going to sleep for 11 seconds 00000100:00100000:2.0:1787823482.767964:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651837824 00000100:00100000:2.0:1787823482.767971:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651837824 00000100:00100000:2.0:1787823482.768205:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787823482.768216:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+16:5835:x1874668651837824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787823482.768393:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+16:5835:x1874668651837824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 179us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823482.768400:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787823482.768474:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922b8ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651837824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787823482.769080:0:8473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922b8ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:8473:1874668651837952:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787823482.769129:0:8473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823482.769624:0:8473:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908cbc180 going to sleep for 11 seconds 00000100:00100000:0.0:1787823482.769698:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651837952 00000100:00100000:0.0:1787823482.769704:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651837952 00000100:00100000:0.0:1787823482.769791:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787823482.769800:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+16:8473:x1874668651837952:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787823482.770267:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+16:8473:x1874668651837952:12345-0@lo:502:llog_process_th.0 Request processed in 468us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823482.770276:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787823482.770608:0:8473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922b8ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:8473:1874668651837952:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787823482.770644:0:8473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787823482.770654:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787823482.770657:0:8473:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787823482.770664:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787823482.770697:0:8473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922b8ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:8473:1874668651838080:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787823482.770736:0:8473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823482.771099:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651838080 00000100:00100000:0.0:1787823482.771104:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651838080 00000100:00100000:0.0:1787823482.771146:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787823482.771154:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+16:8473:x1874668651838080:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787823482.771345:0:8473:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7906d763c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787823482.771717:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+16:8473:x1874668651838080:12345-0@lo:502:llog_process_th.0 Request processed in 563us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823482.771725:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787823482.772133:0:8473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922b8ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:8473:1874668651838080:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787823482.772169:0:8473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787823482.772175:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787823482.772177:0:8473:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787823482.772181:0:8473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1787823482.772338:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1787823482.772364:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787823482.772376:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b83248171f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481726 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823482.772387:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b83248171f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481726 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787823482.772397:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787823482.772400:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e79034dc800 from 39 10000000:01000000:1.0:1787823482.772404:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787823482.772434:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a2f2400/0x5d1142b83248172d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823482.772443:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e793a2f2400/0x5d1142b83248172d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823482.772454:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e793a2f2400/0x5d1142b83248172d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823482.772471:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7926245e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651838208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787823482.772535:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823482.772568:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7907e18000 going to sleep for 11 seconds 00000100:00100000:0.0:1787823482.772661:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651838208 00000100:00100000:0.0:1787823482.772666:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651838208 00000100:00100000:0.0:1787823482.772703:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787823482.772711:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+16:5835:x1874668651838208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787823482.772728:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823482.772741:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7900031000/0x5d1142b832481734 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b83248172d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823482.772800:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7900031000/0x5d1142b832481734 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b83248172d expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823482.772813:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7900031000/0x5d1142b832481734 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b83248172d expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823482.772821:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7900031000, rc 0) 00000100:00100000:0.0:1787823482.772859:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:5835:x1874668651838208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823482.772866:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787823482.773099:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7926245e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651838208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787823482.773112:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e793a2f2400/0x5d1142b83248172d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481734 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823482.773121:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e793a2f2400/0x5d1142b83248172d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b832481734 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823482.773173:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922b8ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651838336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787823482.773199:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823482.773219:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908cbc180 going to sleep for 11 seconds 00000100:00100000:0.0:1787823482.773263:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651838336 00000100:00100000:0.0:1787823482.773267:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651838336 00000100:00100000:0.0:1787823482.773300:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787823482.773306:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:5835:x1874668651838336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787823482.773547:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:5835:x1874668651838336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 240us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823482.773553:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787823482.773664:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922b8ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651838336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787823482.773691:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922b8ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651838464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787823482.773725:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823482.773746:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908cbc180 going to sleep for 11 seconds 00000100:00100000:3.0:1787823482.773794:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651838464 00000100:00100000:3.0:1787823482.773799:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651838464 00000100:00100000:3.0:1787823482.773820:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787823482.773826:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:5835:x1874668651838464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787823482.773977:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:5835:x1874668651838464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823482.773983:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787823482.774190:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922b8ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651838464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787823482.774687:0:8474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922b8ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:8474:1874668651838592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787823482.774728:0:8474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823482.774793:0:8474:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908cbc180 going to sleep for 11 seconds 00000100:00100000:0.0:1787823482.774888:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651838592 00000100:00100000:0.0:1787823482.774893:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651838592 00000100:00100000:0.0:1787823482.774922:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787823482.774941:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:8474:x1874668651838592:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787823482.775307:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:8474:x1874668651838592:12345-0@lo:502:llog_process_th.0 Request processed in 366us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823482.775326:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787823482.775454:0:8474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922b8ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:8474:1874668651838592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787823482.775577:0:8474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922b8ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:8474:1874668651838720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787823482.775615:0:8474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823482.775645:0:8474:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7906d763c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787823482.775689:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651838720 00000100:00100000:0.0:1787823482.775694:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651838720 00000100:00100000:0.0:1787823482.775727:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787823482.775734:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:8474:x1874668651838720:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787823482.776223:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:8474:x1874668651838720:12345-0@lo:502:llog_process_th.0 Request processed in 487us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823482.776230:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787823482.776302:0:8474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922b8ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:8474:1874668651838720:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787823482.776330:0:8474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787823482.776685:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787823482.776707:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787823482.776719:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a2f2400/0x5d1142b83248172d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481734 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823482.776729:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e793a2f2400/0x5d1142b83248172d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481734 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787823482.776740:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787823482.776742:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1787823482.776746:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787823482.777347:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a2f3e00/0x5d1142b83248173b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823482.777359:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e793a2f3e00/0x5d1142b83248173b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823482.777369:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e793a2f3e00/0x5d1142b83248173b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823482.777391:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7926247c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651838848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787823482.777441:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823482.777666:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7907e18540 going to sleep for 11 seconds 00000100:00100000:3.0:1787823482.777752:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651838848 00000100:00100000:3.0:1787823482.778140:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651838848 00000100:00100000:3.0:1787823482.778197:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787823482.778222:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:5835:x1874668651838848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787823482.778238:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823482.778254:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7920eebe00/0x5d1142b832481742 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b83248173b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823482.778280:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7920eebe00/0x5d1142b832481742 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b83248173b expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823482.778292:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7920eebe00/0x5d1142b832481742 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b83248173b expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823482.778302:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7920eebe00, rc 0) 00000100:00100000:3.0:1787823482.778364:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:5835:x1874668651838848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823482.778372:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787823482.778451:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7926247c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651838848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787823482.778470:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e793a2f3e00/0x5d1142b83248173b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481742 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823482.778491:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e793a2f3e00/0x5d1142b83248173b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b832481742 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823482.778572:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7926247c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651838976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787823482.778603:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823482.778638:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7907e18540 going to sleep for 11 seconds 00000100:00100000:3.0:1787823482.778734:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651838976 00000100:00100000:3.0:1787823482.778739:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651838976 00000100:00100000:3.0:1787823482.778797:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787823482.778805:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:5835:x1874668651838976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787823482.779275:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:5835:x1874668651838976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 470us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823482.779283:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787823482.779422:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7926247c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651838976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787823482.779454:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7926247c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651839104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787823482.779494:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823482.779614:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7907e18540 going to sleep for 11 seconds 00000100:00100000:3.0:1787823482.779719:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651839104 00000100:00100000:3.0:1787823482.779723:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651839104 00000100:00100000:3.0:1787823482.779910:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787823482.779919:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:5835:x1874668651839104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787823482.780239:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:5835:x1874668651839104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 321us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823482.780254:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787823482.780341:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7926247c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651839104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787823482.780899:0:8475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4ea1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:8475:1874668651839232:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787823482.780955:0:8475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823482.780983:0:8475:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7909b75f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787823482.781205:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651839232 00000100:00100000:3.0:1787823482.781210:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651839232 00000100:00100000:3.0:1787823482.781245:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787823482.781252:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:8475:x1874668651839232:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787823482.781609:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:8475:x1874668651839232:12345-0@lo:502:llog_process_th.0 Request processed in 356us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823482.781617:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787823482.781741:0:8475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4ea1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:8475:1874668651839232:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787823482.782130:0:8475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787823482.782140:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787823482.782143:0:8475:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787823482.782150:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787823482.782178:0:8475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922b8ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:8475:1874668651839360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787823482.782216:0:8475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823482.782281:0:8475:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e792ea29480 going to sleep for 11 seconds 00000100:00100000:1.0:1787823482.782312:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651839360 00000100:00100000:1.0:1787823482.782317:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651839360 00000100:00100000:1.0:1787823482.782382:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787823482.782392:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:8475:x1874668651839360:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787823482.782648:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:8475:x1874668651839360:12345-0@lo:502:llog_process_th.0 Request processed in 258us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823482.782654:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787823482.782725:0:8475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922b8ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:8475:1874668651839360:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787823482.782745:0:8475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787823482.782750:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787823482.782751:0:8475:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787823482.782791:0:8475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1787823482.783163:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1787823482.783192:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787823482.783206:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a2f3e00/0x5d1142b83248173b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481742 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823482.783218:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e793a2f3e00/0x5d1142b83248173b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481742 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787823482.783244:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787823482.783246:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e7906ef0000 from 1 10000000:01000000:2.0:1787823482.783249:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787823482.783278:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e79358d2400/0x5d1142b832481749 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823482.783285:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e79358d2400/0x5d1142b832481749 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823482.783294:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e79358d2400/0x5d1142b832481749 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823482.783309:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4ea1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651839488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787823482.783348:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823482.783724:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7909b75f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787823482.783918:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651839488 00000100:00100000:3.0:1787823482.783924:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651839488 00000100:00100000:2.0:1787823482.784060:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787823482.784069:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:5835:x1874668651839488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787823482.784081:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823482.784098:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e79358d3200/0x5d1142b832481750 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b832481749 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823482.784123:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e79358d3200/0x5d1142b832481750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b832481749 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823482.784134:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e79358d3200/0x5d1142b832481750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832481749 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823482.784143:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d3200, rc 0) 00000100:00100000:2.0:1787823482.784193:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:5835:x1874668651839488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823482.784199:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787823482.784239:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4ea1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651839488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787823482.784253:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e79358d2400/0x5d1142b832481749 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481750 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823482.784262:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e79358d2400/0x5d1142b832481749 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b832481750 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823482.784311:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4ea1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651839616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787823482.784340:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823482.784359:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7909b75f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787823482.784369:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651839616 00000100:00100000:2.0:1787823482.784373:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651839616 00000100:00100000:2.0:1787823482.784389:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787823482.784395:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:5835:x1874668651839616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787823482.784628:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:5835:x1874668651839616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 233us (287us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787823482.784636:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787823482.784663:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4ea1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651839616:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1787823482.784682:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787823482.784688:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e79358d2400/0x5d1142b832481749 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481750 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823482.784696:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e79358d2400/0x5d1142b832481749 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481750 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823483.114120:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823483.370233:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e79262470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651840128:0@lo:400:kworker.0 00000100:00100000:3.0:1787823483.370312:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823483.370395:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787823483.370402:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7926247840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651839744:0@lo:400:kworker.0 00000100:00100000:3.0:1787823483.370434:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823483.370454:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7926247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874668651840256:0@lo:400:kworker.0 00000100:00100000:3.0:1787823483.370478:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823483.370510:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7926245e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874668651840000:0@lo:400:kworker.0 00000100:00100000:3.0:1787823483.370552:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823483.370573:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787823483.370578:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7926247c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874668651839872:0@lo:400:kworker.0 00000100:00100000:3.0:1787823483.370601:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823483.370616:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7926244780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651840384:0@lo:400:kworker.0 00000100:00100000:3.0:1787823483.370633:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823483.370661:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651840256 00000100:00100000:3.0:1787823483.370688:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651840256 00000100:00100000:3.0:1787823483.370746:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651840000 00000100:00100000:3.0:1787823483.370749:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651840000 00000100:00100000:3.0:1787823483.370807:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651839872 00000100:00100000:3.0:1787823483.370811:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651839872 00000100:00100000:3.0:1787823483.370825:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787823483.370833:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922b8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874668651840256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823483.370883:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922b8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874668651840256:12345-0@lo:400:kworker.0 Request processed in 49us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823483.370891:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787823483.370905:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787823483.370911:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922b88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874668651840000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823483.370955:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922b88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874668651840000:12345-0@lo:400:kworker.0 Request processed in 43us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823483.370962:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787823483.370973:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787823483.370978:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922b89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874668651839872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823483.371003:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922b89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874668651839872:12345-0@lo:400:kworker.0 Request processed in 25us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823483.371008:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787823483.371042:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651840128 00000100:00100000:3.0:1787823483.371046:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651840128 00000100:00100000:3.0:1787823483.371070:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651840384 00000100:00100000:3.0:1787823483.371073:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651840384 00000100:00100000:3.0:1787823483.371087:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787823483.371093:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922b88b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651840128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823483.371123:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922b88b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651840128:12345-0@lo:400:kworker.0 Request processed in 30us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823483.371129:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787823483.371139:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787823483.371145:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922b88780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651840384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823483.371171:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922b88780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651840384:12345-0@lo:400:kworker.0 Request processed in 27us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823483.371177:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787823483.371216:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7926247c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874668651839872:0@lo:400:kworker.0 00010000:00080000:3.0:1787823483.371231:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7926244780 x1874668651840384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823499 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823483.371303:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7926244780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651840384:0@lo:400:kworker.0 00000100:00100000:3.0:1787823483.371315:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7926245e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874668651840000:0@lo:400:kworker.0 00000100:00100000:3.0:1787823483.371345:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7926247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874668651840256:0@lo:400:kworker.0 00010000:00080000:3.0:1787823483.371356:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e79262470c0 x1874668651840128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823499 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823483.371363:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e79262470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651840128:0@lo:400:kworker.0 00000100:00080000:2.0:1787823483.371578:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787823483.371583:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787823483.371586:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787823483.371598:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651839744 00000100:00100000:2.0:1787823483.371603:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651839744 00000100:00100000:2.0:1787823483.371641:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787823483.371648:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3307:x1874668651839744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823483.371695:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3307:x1874668651839744:12345-0@lo:400:kworker.0 Request processed in 48us (1260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823483.371701:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787823483.372501:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7926247840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651839744:0@lo:400:kworker.0 00000100:00100000:2.0:1787823483.883744:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787823483.883792:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651840512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787823483.883891:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823483.884073:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651840512 00000100:00100000:2.0:1787823483.884082:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651840512 00000100:00100000:2.0:1787823483.884129:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787823483.884139:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651840512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787823483.884244:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787823483.884293:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651840512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 154us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823483.884301:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1787823483.884345:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e793a4ea1c0 x1874668651840512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823499 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823483.884364:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651840512:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1787823484.121299:0:8512:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd665d8430 20000000:00000080:1.0:1787823484.121317:0:8512:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e79399b8c00 uarg=0000000000000000 20000000:01000000:1.0:1787823484.121357:0:8512:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787823484.121363:0:8512:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787823484.121369:0:8512:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787823484.123362:0:8513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1787823484.124126:0:8512:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1787823484.135262:0:8512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1787823484.135314:0:8512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1787823484.135382:0:8512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1787823484.135399:0:8512:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787823484.135418:0:8512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e793a2f2600/0x5d1142b832481757 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823484.135436:0:8512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e79013a2000/0x5d1142b8324814cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b8324814c5 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823484.135444:0:8512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7901676200/0x5d1142b83248152e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832481527 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823484.135451:0:8512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e79013a2400/0x5d1142b8324815f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b8324815f2 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823484.135460:0:8512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e79358d2c00/0x5d1142b8324816b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f445dd expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823484.135467:0:8512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e793a2f2600/0x5d1142b832481757 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823484.135693:0:8512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e79358d2c00/0x5d1142b8324816b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f445dd expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823484.135712:0:8512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e79358d2c00/0x5d1142b8324816b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f445dd expref: 9 pid: 5831 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823484.135729:0:8512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e79262461c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1874668651840640:192.168.202.35@tcp:104: 00010000:00010000:1.0:1787823484.135871:0:8512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e79013a2400/0x5d1142b8324815f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d1142b8324815f2 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823484.135879:0:8512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e79013a2400/0x5d1142b8324815f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d1142b8324815f2 expref: 18 pid: 5833 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823484.135895:0:8512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7926245a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1874668651840768:0@lo:104: 00000100:00100000:3.0:1787823484.143308:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823484.143361:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629792512 00000100:00100000:3.0:1787823484.143371:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629792512 00010000:00010000:3.0:1787823484.143410:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e79358d2c00/0x5d1142b8324816b6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f445dd expref: 10 pid: 5831 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823484.143448:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 21 00000100:00100000:3.0:1787823484.143458:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922b8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29690577-71bc-48f4-b24d-bdb875faaf85+10:2353:x1874668629792512:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787823484.143473:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787823484.144537:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e79358d2c00/0x5d1142b8324816b6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f445dd expref: 10 pid: 5831 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823484.144558:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e79358d2c00/0x5d1142b8324816b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f445dd expref: 10 pid: 5831 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823484.144586:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787823484.144674:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922b8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29690577-71bc-48f4-b24d-bdb875faaf85+10:2353:x1874668629792512:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 1216us (1377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823484.144685:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 21 00010000:00010000:2.0:1787823484.145301:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823484.147561:0:8512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787823484.147670:0:8512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7901676200/0x5d1142b83248152e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d1142b832481527 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823484.147686:0:8512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7901676200/0x5d1142b83248152e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d1142b832481527 expref: 18 pid: 5832 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823484.147703:0:8512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e79262470c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1874668651840896:0@lo:104: 00000100:00100000:1.0:1787823484.148100:0:8512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787823484.148142:0:8512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e79013a2000/0x5d1142b8324814cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d1142b8324814c5 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823484.148152:0:8512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e79013a2000/0x5d1142b8324814cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d1142b8324814c5 expref: 18 pid: 5831 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823484.148162:0:8512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7926247480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1874668651841024:0@lo:104: 00000100:00100000:1.0:1787823484.148194:0:8512:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7907e18900 going to sleep for 11 seconds 00010000:00010000:1.0:1787823484.148226:0:8512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e79358d2c00/0x5d1142b8324816b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f445dd expref: 9 pid: 5831 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823484.148239:0:8512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e79262461c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1874668651840640:192.168.202.35@tcp:104: 00000100:00100000:0.0:1787823484.148360:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787823484.148382:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823484.148394:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651840768 00000100:00100000:0.0:1787823484.148400:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651840768 00000100:00100000:0.0:1787823484.148436:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651840896 00000100:00100000:0.0:1787823484.148439:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651840896 00000100:00100000:0.0:1787823484.148447:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651841024 00000100:00100000:0.0:1787823484.148450:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651841024 00000100:00100000:0.0:1787823484.148461:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787823484.148469:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926247840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+5:8512:x1874668651840768:12345-0@lo:104: 00010000:00010000:0.0:1787823484.148495:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff8e7901676e00/0x5d1142b8324815f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b8324815f9 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823484.148570:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787823484.148576:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926247840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+5:8512:x1874668651840768:12345-0@lo:104: Request processed in 108us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823484.148599:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787823484.148617:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787823484.148623:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4adc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+4:8512:x1874668651840896:12345-0@lo:104: 00010000:00010000:0.0:1787823484.148630:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff8e79013a3c00/0x5d1142b832481527 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b83248152e expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823484.148662:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787823484.148667:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4adc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+4:8512:x1874668651840896:12345-0@lo:104: Request processed in 45us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823484.148673:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787823484.148707:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787823484.148713:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7935168000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+3:8512:x1874668651841024:12345-0@lo:104: 00010000:00010000:0.0:1787823484.148720:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff8e7900031c00/0x5d1142b8324814c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b8324814cc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823484.148748:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787823484.148754:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7935168000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+3:8512:x1874668651841024:12345-0@lo:104: Request processed in 42us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823484.148796:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1787823484.149658:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787823484.149667:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e7901676e00/0x5d1142b8324815f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b8324815f9 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823484.149677:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7901676e00 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:3.0:1787823484.149681:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e7901676e00/0x5d1142b8324815f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d1142b8324815f9 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823484.149691:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e7901676e00/0x5d1142b8324815f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d1142b8324815f9 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787823484.149711:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e7901676e00/0x5d1142b8324815f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d1142b8324815f9 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787823484.149717:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787823484.149787:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e7901676e00/0x5d1142b8324815f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b8324815f9 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823484.149793:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787823484.149813:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e7901676e00/0x5d1142b8324815f2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b8324815f9 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823484.149820:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e7901676e00/0x5d1142b8324815f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b8324815f9 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823484.149835:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787823484.149838:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e79013a3c00/0x5d1142b832481527 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b83248152e expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823484.149843:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79013a3c00 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:3.0:1787823484.149846:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e79013a3c00/0x5d1142b832481527 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d1142b83248152e expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823484.149853:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e79013a3c00/0x5d1142b832481527 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d1142b83248152e expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787823484.149859:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e79013a3c00/0x5d1142b832481527 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d1142b83248152e expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787823484.149864:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787823484.149882:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e79013a3c00/0x5d1142b832481527 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b83248152e expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823484.149887:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787823484.149893:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e79013a3c00/0x5d1142b832481527 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b83248152e expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823484.149899:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e79013a3c00/0x5d1142b832481527 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b83248152e expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823484.149908:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787823484.149921:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e7900031c00/0x5d1142b8324814c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b8324814cc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823484.149926:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7900031c00 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:3.0:1787823484.149930:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e7900031c00/0x5d1142b8324814c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d1142b8324814cc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823484.149936:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e7900031c00/0x5d1142b8324814c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d1142b8324814cc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787823484.149942:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e7900031c00/0x5d1142b8324814c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d1142b8324814cc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787823484.149948:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787823484.149957:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e7900031c00/0x5d1142b8324814c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b8324814cc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823484.149963:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787823484.150118:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e7900031c00/0x5d1142b8324814c5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b8324814cc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823484.150135:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e7900031c00/0x5d1142b8324814c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b8324814cc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823484.150149:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823484.150151:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823484.150153:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823484.150159:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823484.150229:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922b88f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651841152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787823484.150275:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823484.150319:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787823484.150324:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922b8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651841280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787823484.150341:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823484.150366:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922b89e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651841408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787823484.150384:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823484.150411:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651841152 00000100:00100000:3.0:1787823484.150417:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651841152 00010000:00010000:3.0:1787823484.150443:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e79013a2400/0x5d1142b8324815f9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b8324815f2 expref: 19 pid: 5833 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823484.150463:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651841280 00000100:00100000:3.0:1787823484.150465:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651841280 00010000:00010000:3.0:1787823484.150473:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7901676200/0x5d1142b83248152e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b832481527 expref: 20 pid: 5832 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823484.150558:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651841408 00000100:00100000:0.0:1787823484.150562:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651841408 00010000:00010000:0.0:1787823484.150577:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e79013a2000/0x5d1142b8324814cc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b8324814c5 expref: 21 pid: 5831 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823484.150598:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787823484.150607:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922b8bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+21:3307:x1874668651841152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787823484.150620:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787823484.150633:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff8e79013a2400/0x5d1142b8324815f9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b8324815f2 expref: 21 pid: 5833 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823484.150644:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e79013a2400/0x5d1142b8324815f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d1142b8324815f2 expref: 21 pid: 5833 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823484.150662:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787823484.150696:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922b8bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+21:3307:x1874668651841152:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823484.150704:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787823484.150721:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787823484.150726:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922b8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+20:3305:x1874668651841408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787823484.150735:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787823484.150738:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e79013a2000/0x5d1142b8324814cc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b8324814c5 expref: 20 pid: 5831 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823484.150745:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e79013a2000/0x5d1142b8324814cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d1142b8324814c5 expref: 20 pid: 5831 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823484.150753:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787823484.150808:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922b8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+20:3305:x1874668651841408:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823484.150814:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1787823484.150999:0:8512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e79013a2400/0x5d1142b8324815f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d1142b8324815f2 expref: 19 pid: 5833 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823484.151014:0:8512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7926245a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1874668651840768:0@lo:104: 00000100:00100000:1.0:1787823484.151026:0:8512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e79262470c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1874668651840896:0@lo:104: 00010000:00010000:1.0:1787823484.151045:0:8512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e79013a2000/0x5d1142b8324814cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d1142b8324814c5 expref: 18 pid: 5831 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823484.151054:0:8512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7926247480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1874668651841024:0@lo:104: 00010000:00010000:1.0:1787823484.151081:0:8512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e793a2f2600/0x5d1142b832481757 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823484.151331:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787823484.151340:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922b8b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:3307:x1874668651841280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787823484.151348:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787823484.151359:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7901676200/0x5d1142b83248152e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b832481527 expref: 17 pid: 5832 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823484.151368:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7901676200/0x5d1142b83248152e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d1142b832481527 expref: 17 pid: 5832 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823484.151378:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7901676200/0x5d1142b83248152e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d1142b832481527 expref: 17 pid: 5832 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823484.151388:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e793a2f2600/0x5d1142b832481757 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823484.151395:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e793a2f2600/0x5d1142b832481757 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823484.151409:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e793a2f2600/0x5d1142b832481757 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823484.151416:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e793a2f2600/0x5d1142b832481757 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823484.151423:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e793a2f2600/0x5d1142b832481757 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823484.151430:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e793a2f2600/0x5d1142b832481757 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823484.151435:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f2600 already unused, calling callback (ffffffffc1649440) 00010000:00010000:3.0:1787823484.151439:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e793a2f2600/0x5d1142b832481757 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823484.151447:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e793a2f2600/0x5d1142b832481757 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823484.152262:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e793a2f2600/0x5d1142b832481757 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823484.152281:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787823484.152334:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922b8b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+16:3307:x1874668651841280:12345-0@lo:103:ldlm_bl.0 Request processed in 996us (1990us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823484.152343:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787823484.152409:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922b89e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651841408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787823484.152439:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922b8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651841280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787823484.152449:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922b88f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651841152:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787823484.152720:0:8512:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e793a2f2600/0x5d1142b832481757 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823484.152729:0:8512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e793a2f2600/0x5d1142b832481757 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823484.152736:0:8512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e793a2f2600/0x5d1142b832481757 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823484.153287:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823485.161933:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823486.024162:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823486.026394:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629792640 00000100:00100000:3.0:1787823486.026410:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629792640 00000100:00100000:2.0:1787823486.026568:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 173 00000100:00100000:2.0:1787823486.026582:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+9:5595:x1874668629792640:12345-192.168.202.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787823486.026599:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823486.026621:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e79358d3800/0x5d1142b83248175e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe697ab316f4461c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823486.026651:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e79358d3800/0x5d1142b83248175e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4461c expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823486.026661:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e79358d3800/0x5d1142b83248175e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4461c expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823486.026670:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d3800, rc 0) 00000100:00100000:2.0:1787823486.026733:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+10:5595:x1874668629792640:12345-192.168.202.35@tcp:101:ll_cfg_requeue.0 Request processed in 155us (2582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823486.026741:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 173 00000100:00100000:1.0:1787823486.030571:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823486.030699:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629792768 00000100:00100000:3.0:1787823486.030708:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629792768 00000100:00100000:3.0:1787823486.030792:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 174 00000100:00100000:3.0:1787823486.030803:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+10:5595:x1874668629792768:12345-192.168.202.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787823486.031096:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+10:5595:x1874668629792768:12345-192.168.202.35@tcp:501:ll_cfg_requeue.0 Request processed in 293us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823486.031105:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 174 00000100:00100000:2.0:1787823486.033218:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823486.033451:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629792896 00000100:00100000:3.0:1787823486.033459:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629792896 00000100:00100000:3.0:1787823486.033515:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 175 00000100:00100000:3.0:1787823486.033524:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+10:5595:x1874668629792896:12345-192.168.202.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787823486.033732:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+10:5595:x1874668629792896:12345-192.168.202.35@tcp:503:ll_cfg_requeue.0 Request processed in 208us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823486.033748:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 175 00000100:00100000:1.0:1787823486.042469:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823486.042689:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629793024 00000100:00100000:3.0:1787823486.042700:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629793024 00000100:00100000:3.0:1787823486.042809:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 176 00000100:00100000:3.0:1787823486.042819:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+10:6130:x1874668629793024:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787823486.043427:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+10:6130:x1874668629793024:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 607us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823486.043437:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 176 00000100:00100000:2.0:1787823486.049731:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823486.052151:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629793152 00000100:00100000:1.0:1787823486.052166:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629793152 00000100:00100000:1.0:1787823486.053183:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 177 00000100:00100000:1.0:1787823486.053200:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+10:6130:x1874668629793152:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787823486.053456:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+10:6130:x1874668629793152:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 261us (3739us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823486.053466:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 177 10000000:01000000:3.0:1787823486.060818:0:5835:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787823486.060826:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e7903710800 from 4 10000000:01000000:3.0:1787823486.061107:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787823486.061148:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7920eebc00/0x5d1142b832481765 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823486.061158:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e7920eebc00/0x5d1142b832481765 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823486.061170:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e7920eebc00/0x5d1142b832481765 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823486.061197:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922b8b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651841536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787823486.061273:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823486.061461:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7910029780 going to sleep for 11 seconds 00000100:00100000:2.0:1787823486.061823:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651841536 00000100:00100000:2.0:1787823486.061830:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651841536 00000100:00100000:2.0:1787823486.061913:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787823486.061923:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+16:5835:x1874668651841536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787823486.061937:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823486.061952:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e79358d2200/0x5d1142b83248176c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b832481765 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823486.061997:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e79358d2200/0x5d1142b83248176c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b832481765 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823486.062009:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e79358d2200/0x5d1142b83248176c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832481765 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823486.062019:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d2200, rc 0) 00000100:00100000:2.0:1787823486.062075:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:5835:x1874668651841536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823486.062083:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787823486.062157:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922b8b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651841536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787823486.062173:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e7920eebc00/0x5d1142b832481765 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248176c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823486.062193:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e7920eebc00/0x5d1142b832481765 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b83248176c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823486.062251:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922b8b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651841664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787823486.062273:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823486.062299:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7910029780 going to sleep for 11 seconds 00000100:00100000:2.0:1787823486.062340:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651841664 00000100:00100000:2.0:1787823486.062343:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651841664 00000100:00100000:2.0:1787823486.062377:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787823486.062383:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903726450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:5835:x1874668651841664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787823486.062627:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903726450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:5835:x1874668651841664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 244us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823486.062633:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787823486.062662:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922b8b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651841664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787823486.062698:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7935169680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651841792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787823486.062740:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823486.062789:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a79d780 going to sleep for 11 seconds 00000100:00100000:2.0:1787823486.063870:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651841792 00000100:00100000:2.0:1787823486.063882:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651841792 00000100:00100000:2.0:1787823486.064270:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787823486.064280:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:5835:x1874668651841792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787823486.064498:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:5835:x1874668651841792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 220us (1757us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823486.064505:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787823486.064547:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7935169680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651841792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787823486.065079:0:8583:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922b89e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:8583:1874668651841920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787823486.065116:0:8583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823486.065145:0:8583:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793b31f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787823486.065190:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651841920 00000100:00100000:1.0:1787823486.065196:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651841920 00000100:00100000:1.0:1787823486.065232:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787823486.065248:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:8583:x1874668651841920:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787823486.065404:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:8583:x1874668651841920:12345-0@lo:502:llog_process_th.0 Request processed in 155us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823486.065413:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787823486.065424:0:8583:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922b89e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:8583:1874668651841920:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787823486.065446:0:8583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787823486.065454:0:8583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787823486.065456:0:8583:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787823486.065461:0:8583:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e7903710800 00000020:00000080:3.0:1787823486.065471:0:8583:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787823486.066524:0:8583:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922b89e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:8583:1874668651842048:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787823486.066572:0:8583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823486.066596:0:8583:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793b31f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787823486.069214:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651842048 00000100:00100000:0.0:1787823486.069233:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651842048 00000100:00100000:0.0:1787823486.069297:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787823486.069309:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903727450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:8583:x1874668651842048:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787823486.069581:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903727450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:8583:x1874668651842048:12345-0@lo:502:llog_process_th.0 Request processed in 275us (3008us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823486.069589:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787823486.070997:0:8583:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922b89e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:8583:1874668651842048:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787823486.071044:0:8583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787823486.071053:0:8583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787823486.071056:0:8583:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787823486.071065:0:8583:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787823486.071317:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787823486.071339:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787823486.071351:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7920eebc00/0x5d1142b832481765 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248176c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823486.071362:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e7920eebc00/0x5d1142b832481765 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248176c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787823486.071372:0:5835:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787823486.071375:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e7909bc2800 from 4 10000000:01000000:1.0:1787823486.071378:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787823486.071410:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a2f2200/0x5d1142b832481773 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823486.071418:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e793a2f2200/0x5d1142b832481773 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823486.071429:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e793a2f2200/0x5d1142b832481773 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823486.071451:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7926247480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651842176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787823486.071511:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823486.071551:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7907e18180 going to sleep for 11 seconds 00000100:00100000:2.0:1787823486.074022:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651842176 00000100:00100000:2.0:1787823486.074038:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651842176 00000100:00100000:2.0:1787823486.074109:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787823486.074119:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903727850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:5835:x1874668651842176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787823486.074145:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823486.074163:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e79358d2e00/0x5d1142b83248177a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b832481773 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823486.074190:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e79358d2e00/0x5d1142b83248177a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b832481773 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823486.074200:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e79358d2e00/0x5d1142b83248177a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832481773 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823486.074209:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d2e00, rc 0) 00000100:00100000:2.0:1787823486.074286:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903727850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:5835:x1874668651842176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (2777us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823486.074293:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787823486.074440:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7926247480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651842176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787823486.074461:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e793a2f2200/0x5d1142b832481773 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248177a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823486.074470:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e793a2f2200/0x5d1142b832481773 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b83248177a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823486.074549:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793516a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651842304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787823486.074584:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823486.075687:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a79d840 going to sleep for 11 seconds 00000100:00100000:2.0:1787823486.079004:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651842304 00000100:00100000:2.0:1787823486.079021:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651842304 00000100:00100000:2.0:1787823486.079083:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787823486.079094:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903724450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:5835:x1874668651842304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787823486.079428:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903724450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:5835:x1874668651842304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 336us (4842us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823486.079438:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787823486.079594:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793516a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651842304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787823486.079649:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922b89a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651842432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787823486.079693:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823486.079733:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e780118ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1787823486.081858:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651842432 00000100:00100000:2.0:1787823486.081872:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651842432 00000100:00100000:2.0:1787823486.082520:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787823486.082584:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:5835:x1874668651842432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787823486.083414:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:5835:x1874668651842432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 873us (3712us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823486.083790:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787823486.090104:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922b89a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651842432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787823486.090393:0:8587:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793516a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:8587:1874668651842560:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787823486.090468:0:8587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823486.090507:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651842560 00000100:00100000:0.0:1787823486.090513:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651842560 00000100:00100000:0.0:1787823486.090559:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787823486.090567:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903726850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:8587:x1874668651842560:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787823486.090802:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903726850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:8587:x1874668651842560:12345-0@lo:502:llog_process_th.0 Request processed in 235us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823486.090810:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787823486.090855:0:8587:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a30c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787823486.090868:0:8587:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793516a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:8587:1874668651842560:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787823486.090889:0:8587:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787823486.090967:0:8587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787823486.090970:0:8587:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787823486.090981:0:8587:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e7909bc2800 00000020:00000080:0.0:1787823486.090984:0:8587:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787823486.091052:0:8587:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793516a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:8587:1874668651842688:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787823486.091085:0:8587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823486.091099:0:8587:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a30c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787823486.092744:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651842688 00000100:00100000:2.0:1787823486.092789:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651842688 00000100:00100000:2.0:1787823486.092848:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787823486.092858:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:8587:x1874668651842688:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787823486.094623:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:8587:x1874668651842688:12345-0@lo:502:llog_process_th.0 Request processed in 1757us (3528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823486.094636:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787823486.094689:0:8587:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793516a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:8587:1874668651842688:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787823486.094740:0:8587:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787823486.094749:0:8587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787823486.094783:0:8587:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787823486.094790:0:8587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787823486.097864:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787823486.097908:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787823486.097923:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a2f2200/0x5d1142b832481773 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248177a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823486.097936:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e793a2f2200/0x5d1142b832481773 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248177a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787823486.097947:0:5835:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787823486.097950:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e79034dc800 from 4 10000000:01000000:0.0:1787823486.097953:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787823486.097995:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7900030400/0x5d1142b832481781 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823486.098013:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e7900030400/0x5d1142b832481781 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823486.098024:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e7900030400/0x5d1142b832481781 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823486.098049:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793516b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651842816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787823486.098128:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823486.098177:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a30c840 going to sleep for 11 seconds 00000100:00100000:0.0:1787823486.098212:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651842816 00000100:00100000:0.0:1787823486.098218:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651842816 00000100:00100000:0.0:1787823486.098265:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787823486.098274:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:5835:x1874668651842816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787823486.098287:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823486.098302:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7900030000/0x5d1142b832481788 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b832481781 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823486.098326:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7900030000/0x5d1142b832481788 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b832481781 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823486.098336:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7900030000/0x5d1142b832481788 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832481781 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823486.098344:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7900030000, rc 0) 00000100:00100000:0.0:1787823486.098382:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:5835:x1874668651842816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823486.098388:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787823486.098440:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793516b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651842816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787823486.098456:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e7900030400/0x5d1142b832481781 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481788 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823486.098463:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e7900030400/0x5d1142b832481781 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b832481788 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823486.098508:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793516b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651842944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787823486.098531:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823486.098545:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a30c840 going to sleep for 11 seconds 00000100:00100000:0.0:1787823486.098555:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651842944 00000100:00100000:0.0:1787823486.098558:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651842944 00000100:00100000:0.0:1787823486.098576:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787823486.098581:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:5835:x1874668651842944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787823486.098860:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:5835:x1874668651842944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 277us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823486.098867:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787823486.098894:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793516b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651842944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787823486.098918:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793516b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651843072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787823486.098951:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823486.098962:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a30c840 going to sleep for 11 seconds 00000100:00100000:0.0:1787823486.098974:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651843072 00000100:00100000:0.0:1787823486.098977:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651843072 00000100:00100000:0.0:1787823486.098994:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787823486.099000:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7908c44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:5835:x1874668651843072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787823486.099127:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7908c44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:5835:x1874668651843072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823486.099140:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787823486.099173:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793516b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651843072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787823486.099404:0:8588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793516b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:8588:1874668651843200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787823486.099443:0:8588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823486.099464:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651843200 00000100:00100000:0.0:1787823486.099468:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651843200 00000100:00100000:0.0:1787823486.099489:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787823486.099495:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7908c45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:8588:x1874668651843200:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787823486.099645:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7908c45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:8588:x1874668651843200:12345-0@lo:502:llog_process_th.0 Request processed in 150us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823486.099652:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787823486.099686:0:8588:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a30c840 going to sleep for 11 seconds 00000100:00100000:0.0:1787823486.099697:0:8588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793516b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:8588:1874668651843200:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787823486.099720:0:8588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787823486.099731:0:8588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787823486.099733:0:8588:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787823486.099744:0:8588:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e79034dc800 00000020:00000080:0.0:1787823486.099748:0:8588:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787823486.099850:0:8588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793516b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:8588:1874668651843328:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787823486.099885:0:8588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823486.099905:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651843328 00000100:00100000:0.0:1787823486.099909:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651843328 00000100:00100000:0.0:1787823486.099929:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787823486.099935:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:8588:x1874668651843328:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787823486.100038:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:8588:x1874668651843328:12345-0@lo:502:llog_process_th.0 Request processed in 102us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823486.100050:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787823486.100087:0:8588:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a47a780 going to sleep for 11 seconds 00000100:00100000:0.0:1787823486.100098:0:8588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793516b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:8588:1874668651843328:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787823486.100118:0:8588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787823486.100122:0:8588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787823486.100124:0:8588:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787823486.100129:0:8588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787823486.100176:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787823486.100193:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787823486.100201:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7900030400/0x5d1142b832481781 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481788 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823486.100210:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e7900030400/0x5d1142b832481781 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481788 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823486.189200:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823486.444284:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787823486.444310:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e79262470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651843456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787823486.444396:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823486.446699:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651843456 00000100:00100000:1.0:1787823486.446712:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651843456 00000100:00100000:1.0:1787823486.446800:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787823486.446810:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926245a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651843456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787823486.446845:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787823486.446989:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926245a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651843456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 181us (2593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823486.446997:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1787823486.447019:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787823486.447054:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e79262470c0 x1874668651843456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823502 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787823486.447081:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e79262470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651843456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787823487.180527:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823487.180583:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823487.180620:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823487.180664:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823487.180829:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629793536 00000100:00100000:3.0:1787823487.180840:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629793536 00000100:00100000:3.0:1787823487.180921:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629793664 00000100:00100000:3.0:1787823487.180928:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629793664 00000100:00100000:3.0:1787823487.180950:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 17 00000100:00100000:3.0:1787823487.180961:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79262470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+5:2352:x1874668629793536:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787823487.181036:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79262470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+5:2352:x1874668629793536:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 76us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823487.181044:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 17 00000100:00100000:3.0:1787823487.181061:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 18 00000100:00100000:3.0:1787823487.181067:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926245e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+5:2352:x1874668629793664:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787823487.181091:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926245e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+5:2352:x1874668629793664:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 24us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823487.181098:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 18 00000100:00100000:0.0:1787823487.181231:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629793280 00000100:00100000:0.0:1787823487.181235:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629793280 00000100:00100000:0.0:1787823487.181273:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 193 00000100:00100000:0.0:1787823487.181281:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+10:2352:x1874668629793280:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787823487.181309:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+10:2352:x1874668629793280:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 30us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823487.181316:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 193 00000100:00080000:1.0:1787823487.181640:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787823487.181646:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787823487.182882:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629793408 00000100:00100000:2.0:1787823487.182892:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629793408 00000100:00100000:2.0:1787823487.182967:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 33 00000100:00100000:2.0:1787823487.182977:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79262461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+6:2352:x1874668629793408:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787823487.183031:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79262461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+6:2352:x1874668629793408:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 56us (2410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823487.183038:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 33 00000100:00080000:3.0:1787823487.183203:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787823487.210036:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823488.237808:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823488.492590:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793516b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651843584:0@lo:400:kworker.0 00000100:00100000:3.0:1787823488.492676:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823488.492851:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651843584 00000100:00100000:2.0:1787823488.492859:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651843584 00000100:00100000:2.0:1787823488.492915:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787823488.492925:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3307:x1874668651843584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823488.498670:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793516bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874668651843712:0@lo:400:kworker.0 00000100:00100000:0.0:1787823488.498755:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823488.498808:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7935168f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651844224:0@lo:400:kworker.0 00000100:00100000:0.0:1787823488.498836:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823488.498873:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787823488.498880:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793516b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874668651844096:0@lo:400:kworker.0 00000100:00100000:0.0:1787823488.498903:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823488.498938:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7935169e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874668651843840:0@lo:400:kworker.0 00000100:00100000:0.0:1787823488.498961:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823488.498981:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787823488.498987:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793516b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651843968:0@lo:400:kworker.0 00000100:00100000:0.0:1787823488.499009:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823488.499037:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651843712 00000100:00100000:0.0:1787823488.499045:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651843712 00000100:00100000:0.0:1787823488.499090:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651844096 00000100:00100000:0.0:1787823488.499093:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651844096 00000100:00100000:0.0:1787823488.499114:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651843840 00000100:00100000:0.0:1787823488.499117:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651843840 00000100:00100000:0.0:1787823488.499132:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787823488.499139:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793516a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874668651843712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823488.499189:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793516a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874668651843712:12345-0@lo:400:kworker.0 Request processed in 49us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823488.499196:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787823488.499211:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787823488.499217:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7935169680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874668651844096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823488.499244:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7935169680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874668651844096:12345-0@lo:400:kworker.0 Request processed in 28us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823488.499250:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787823488.499261:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787823488.499267:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7935168780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874668651843840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823488.499309:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7935168780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874668651843840:12345-0@lo:400:kworker.0 Request processed in 42us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823488.499322:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787823488.499342:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651844224 00000100:00100000:0.0:1787823488.499346:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651844224 00000100:00100000:0.0:1787823488.499370:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651843968 00000100:00100000:0.0:1787823488.499373:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651843968 00000100:00100000:0.0:1787823488.499386:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787823488.499391:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793516a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651844224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823488.499425:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793516a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651844224:12345-0@lo:400:kworker.0 Request processed in 33us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823488.499432:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787823488.499443:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787823488.499448:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7935169a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651843968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823488.499488:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7935169a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651843968:12345-0@lo:400:kworker.0 Request processed in 41us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823488.499495:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1787823488.499521:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787823488.499525:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787823488.499528:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787823488.499558:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e793516b0c0 x1874668651843968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823504 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823488.499574:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793516b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651843968:0@lo:400:kworker.0 00000100:00100000:0.0:1787823488.499586:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7935169e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874668651843840:0@lo:400:kworker.0 00000100:00100000:0.0:1787823488.499613:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793516b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874668651844096:0@lo:400:kworker.0 00000100:00100000:0.0:1787823488.499623:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793516bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874668651843712:0@lo:400:kworker.0 00010000:00080000:0.0:1787823488.499632:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7935168f00 x1874668651844224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823504 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823488.499648:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7935168f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651844224:0@lo:400:kworker.0 00000100:00100000:2.0:1787823488.499898:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3307:x1874668651843584:12345-0@lo:400:kworker.0 Request processed in 6973us (7220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823488.499908:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787823488.502561:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793516b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651843584:0@lo:400:kworker.0 00000100:00100000:2.0:1787823489.004721:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787823489.004800:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922b8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651844352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787823489.004983:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823489.005091:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651844352 00000100:00100000:3.0:1787823489.005103:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651844352 00000100:00100000:3.0:1787823489.005156:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787823489.005163:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651844352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787823489.005192:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787823489.005224:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651844352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823489.005229:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1787823489.005291:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7922b8b0c0 x1874668651844352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823505 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823489.005309:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922b8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651844352:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787823489.262229:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823490.281905:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787823490.782528:0:8811:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg235-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1787823491.308945:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823491.565518:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787823491.565546:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922b8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651844480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787823491.565619:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823491.565686:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651844480 00000100:00100000:3.0:1787823491.565693:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651844480 00000100:00100000:3.0:1787823491.565783:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787823491.565793:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922b8ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651844480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787823491.565829:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787823491.565872:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922b8ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651844480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823491.565878:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1787823491.565899:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787823491.566011:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7922b8b0c0 x1874668651844480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823507 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823491.566031:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922b8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651844480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787823492.297417:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823492.300680:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629793792 00000100:00100000:3.0:1787823492.300694:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629793792 00000100:00100000:3.0:1787823492.300785:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 195 00000100:00100000:3.0:1787823492.300796:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+10:2352:x1874668629793792:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787823492.300893:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+10:2352:x1874668629793792:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 99us (3488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823492.300901:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 195 00000100:00100000:1.0:1787823492.302885:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823492.302937:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823492.302960:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629793920 00000100:00100000:0.0:1787823492.302971:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629793920 00000100:00100000:1.0:1787823492.302978:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823492.303042:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629794048 00000100:00100000:0.0:1787823492.303046:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 37 00000100:00100000:2.0:1787823492.303047:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629794048 00000100:00100000:0.0:1787823492.303057:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926247c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+6:2353:x1874668629793920:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787823492.303078:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629794176 00000100:00100000:2.0:1787823492.303081:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629794176 00000100:00100000:2.0:1787823492.303101:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 21 00000100:00100000:3.0:1787823492.303110:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 22 00000100:00100000:2.0:1787823492.303111:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926244780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:353832f0-fe7b-4d99-975c-a8041babed42+5:2352:x1874668629794048:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787823492.303122:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926247c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+6:2353:x1874668629793920:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 68us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823492.303127:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+5:2353:x1874668629794176:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787823492.303137:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 37 00000100:00100000:2.0:1787823492.303140:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926244780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:353832f0-fe7b-4d99-975c-a8041babed42+5:2352:x1874668629794048:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 34us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823492.303146:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 21 00000100:00100000:3.0:1787823492.303171:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+5:2353:x1874668629794176:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 50us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823492.303180:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 22 00000100:00080000:2.0:1787823492.303181:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787823492.303187:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787823492.303191:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787823492.329937:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823493.355958:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823493.609993:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793516b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651844992:0@lo:400:kworker.0 00000100:00100000:0.0:1787823493.610076:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823493.610143:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787823493.610148:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7935169e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874668651844864:0@lo:400:kworker.0 00000100:00100000:0.0:1787823493.610170:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823493.610200:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651844992 00000100:00100000:0.0:1787823493.610207:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651844992 00000100:00100000:0.0:1787823493.610261:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787823493.610269:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792eb07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651844992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823493.610316:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792eb07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651844992:12345-0@lo:400:kworker.0 Request processed in 48us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823493.610323:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787823493.610343:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651844864 00000100:00100000:0.0:1787823493.610346:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651844864 00000100:00100000:0.0:1787823493.610370:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787823493.610377:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792eb04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874668651844864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823493.610410:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792eb04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874668651844864:12345-0@lo:400:kworker.0 Request processed in 34us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823493.610417:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1787823493.610434:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787823493.610438:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787823493.610470:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7935169e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874668651844864:0@lo:400:kworker.0 00010000:00080000:0.0:1787823493.610484:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e793516b0c0 x1874668651844992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823509 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823493.610493:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793516b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651844992:0@lo:400:kworker.0 00000100:00100000:1.0:1787823493.610727:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793516b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874668651844736:0@lo:400:kworker.0 00000100:00100000:1.0:1787823493.610775:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823493.610809:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790ae830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651845248:0@lo:400:kworker.0 00000100:00100000:1.0:1787823493.610856:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823493.610883:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787823493.610889:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793516bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3308:1874668651844608:0@lo:400:kworker.0 00000100:00100000:1.0:1787823493.610918:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823493.610941:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793516b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874668651845120:0@lo:400:kworker.0 00000100:00100000:1.0:1787823493.610961:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823493.611135:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651844608 00000100:00100000:1.0:1787823493.611139:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651844608 00000100:00100000:1.0:1787823493.611170:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787823493.611178:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3308:x1874668651844608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823493.611216:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3308:x1874668651844608:12345-0@lo:400:kworker.0 Request processed in 39us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823493.611222:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787823493.611249:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651844736 00000100:00100000:1.0:1787823493.611252:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651844736 00000100:00100000:1.0:1787823493.611273:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651845120 00000100:00100000:1.0:1787823493.611275:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651845120 00000100:00100000:1.0:1787823493.611299:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787823493.611305:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926247840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874668651844736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823493.611336:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926247840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874668651844736:12345-0@lo:400:kworker.0 Request processed in 31us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823493.611357:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787823493.611368:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787823493.611374:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874668651845120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823493.611400:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874668651845120:12345-0@lo:400:kworker.0 Request processed in 27us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823493.611414:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1787823493.611435:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787823493.611455:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793516bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3308:1874668651844608:0@lo:400:kworker.0 00000100:00100000:1.0:1787823493.611465:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793516b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874668651845120:0@lo:400:kworker.0 00000100:00100000:1.0:1787823493.611473:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793516b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874668651844736:0@lo:400:kworker.0 00000100:00100000:3.0:1787823493.611582:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651845248 00000100:00100000:3.0:1787823493.611586:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651845248 00000100:00100000:3.0:1787823493.611627:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787823493.611635:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939dc0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651845248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823493.611671:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939dc0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651845248:12345-0@lo:400:kworker.0 Request processed in 38us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823493.611678:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1787823493.612951:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787823493.613120:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e790ae830c0 x1874668651845248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823509 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787823493.613135:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790ae830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651845248:0@lo:400:kworker.0 00000100:00100000:2.0:1787823494.121962:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922b8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651845376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787823494.122033:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823494.122199:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651845376 00000100:00100000:3.0:1787823494.122208:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651845376 00000100:00100000:3.0:1787823494.122418:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787823494.122430:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651845376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787823494.122466:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787823494.122523:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651845376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823494.122531:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1787823494.122619:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7922b8b0c0 x1874668651845376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823510 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823494.122637:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922b8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651845376:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787823494.379315:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823495.409331:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787823496.185565:0:9055:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg235-server.virtnet: executing yml_node 00010000:00010000:3.0:1787823496.427884:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787823496.684499:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787823496.684525:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651845504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787823496.684599:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823496.684678:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651845504 00000100:00100000:2.0:1787823496.684687:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651845504 00000100:00100000:2.0:1787823496.684752:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787823496.684786:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651845504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787823496.685032:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787823496.689035:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651845504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4236us (4421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823496.689060:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1787823496.689116:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787823496.689974:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e793a4e92c0 x1874668651845504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823512 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787823496.690004:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651845504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787823497.422534:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823497.422578:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823497.422662:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823497.422690:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823497.422724:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629794432 00000100:00100000:1.0:1787823497.422735:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629794432 00000100:00100000:1.0:1787823497.422835:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 41 00000100:00100000:1.0:1787823497.422845:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939dc30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+6:2355:x1874668629794432:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787823497.422917:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939dc30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+6:2355:x1874668629794432:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 74us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823497.422955:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 41 00000100:00100000:1.0:1787823497.422977:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629794560 00000100:00100000:1.0:1787823497.422981:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629794560 00000100:00100000:1.0:1787823497.423003:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629794688 00000100:00100000:1.0:1787823497.423006:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629794688 00000100:00100000:1.0:1787823497.423023:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 10 00000100:00100000:1.0:1787823497.423029:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939dc0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+5:2351:x1874668629794560:12345-192.168.202.35@tcp:9:kworker.0 00000020:00000080:1.0:1787823497.423054:0:6686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d1142b8324816c4 00000100:00080000:1.0:1787823497.423063:0:6686:0:(import.c:65:import_set_state_nolock()) ffff8e792ee51800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787823497.423091:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1787823497.423098:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787823497.423928:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939dc0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+2:2351:x1874668629794560:12345-192.168.202.35@tcp:9:kworker.0 Request processed in 890us (1397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823497.423948:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 10 00000100:00100000:1.0:1787823497.423970:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 11 00000100:00100000:1.0:1787823497.423980:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939dc1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+5:2351:x1874668629794688:12345-192.168.202.35@tcp:9:kworker.0 00000020:00000080:1.0:1787823497.424008:0:6686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d1142b8324816cb 00000100:00080000:1.0:1787823497.424016:0:6686:0:(import.c:65:import_set_state_nolock()) ffff8e792ee56000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787823497.424029:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629794304 00000100:00100000:2.0:1787823497.424035:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629794304 00000001:00000004:1.0:1787823497.424048:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787823497.424103:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 197 00000100:00100000:2.0:1787823497.424110:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+10:2355:x1874668629794304:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787823497.424137:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+10:2355:x1874668629794304:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 28us (1558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823497.424156:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 197 00010000:00010000:3.0:1787823497.424215:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823497.424318:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939dc1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+2:2351:x1874668629794688:12345-192.168.202.35@tcp:9:kworker.0 Request processed in 340us (1626us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823497.424326:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 11 00000100:00080000:2.0:1787823497.424464:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787823497.424469:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787823497.424472:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787823497.452183:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823498.474632:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823498.735934:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874668651845760:0@lo:400:kworker.0 00000100:00100000:2.0:1787823498.735938:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651846016:0@lo:400:kworker.0 00000100:00100000:3.0:1787823498.736005:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651845632:0@lo:400:kworker.0 00000100:00100000:0.0:1787823498.736057:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874668651845888:0@lo:400:kworker.0 00000100:00100000:2.0:1787823498.742633:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823498.742782:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651846016 00000100:00100000:2.0:1787823498.742804:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651846016 00000100:00100000:2.0:1787823498.742871:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787823498.742881:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651846016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823498.742938:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651846016:12345-0@lo:400:kworker.0 Request processed in 58us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823498.742946:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1787823498.742967:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787823498.742996:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e793a4eb0c0 x1874668651846016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823498.743009:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651846016:0@lo:400:kworker.0 00000100:00100000:3.0:1787823498.743512:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823498.743545:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874668651846144:0@lo:400:kworker.0 00000100:00100000:3.0:1787823498.743572:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823498.743597:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651845632 00000100:00100000:3.0:1787823498.743604:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787823498.743610:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651846272:0@lo:400:kworker.0 00000100:00100000:2.0:1787823498.743612:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651845632 00000100:00100000:3.0:1787823498.743632:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823498.743640:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787823498.743658:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3307:x1874668651845632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823498.743694:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651846144 00000100:00100000:2.0:1787823498.743697:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3307:x1874668651845632:12345-0@lo:400:kworker.0 Request processed in 41us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823498.743698:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651846144 00000100:00100000:2.0:1787823498.743703:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787823498.743731:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787823498.743738:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922b892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874668651846144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823498.743738:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651845632:0@lo:400:kworker.0 00000100:00080000:2.0:1787823498.743774:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787823498.743795:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922b892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874668651846144:12345-0@lo:400:kworker.0 Request processed in 49us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823498.743803:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787823498.743829:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874668651846144:0@lo:400:kworker.0 00000100:00100000:3.0:1787823498.743851:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651846272 00000100:00100000:3.0:1787823498.743855:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651846272 00000100:00100000:0.0:1787823498.743923:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823498.743970:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651845888 00000100:00100000:2.0:1787823498.743974:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651845888 00000100:00100000:3.0:1787823498.744591:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787823498.744601:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922b8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651846272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823498.744679:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922b8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651846272:12345-0@lo:400:kworker.0 Request processed in 70us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823498.744686:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1787823498.744721:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e793a4ea580 x1874668651846272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823498.744732:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651846272:0@lo:400:kworker.0 00000100:00100000:3.0:1787823498.749069:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787823498.749087:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792eb070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874668651845888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823498.749190:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792eb070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874668651845888:12345-0@lo:400:kworker.0 Request processed in 110us (5267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823498.749197:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787823498.749506:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823498.749583:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874668651845888:0@lo:400:kworker.0 00000100:00100000:3.0:1787823498.749593:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651845760 00000100:00100000:3.0:1787823498.749600:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651845760 00000100:00100000:3.0:1787823498.749635:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787823498.749653:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939dc3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874668651845760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823498.749754:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939dc3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874668651845760:12345-0@lo:400:kworker.0 Request processed in 112us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823498.749778:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1787823498.750125:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787823498.750132:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787823498.754049:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874668651845760:0@lo:400:kworker.0 00000100:00100000:1.0:1787823499.242238:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922b88f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651846400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787823499.242312:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823499.242442:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651846400 00000100:00100000:2.0:1787823499.242451:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651846400 00000100:00100000:2.0:1787823499.242503:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787823499.242523:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939dc3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651846400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787823499.242580:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787823499.243401:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939dc3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651846400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 886us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823499.243412:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1787823499.244031:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7922b88f00 x1874668651846400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823515 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787823499.244059:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922b88f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651846400:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787823499.498291:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823500.522128:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787823500.830421:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 353832f0-fe7b-4d99-975c-a8041babed42 00000020:00000080:0.0:1787823500.830431:0:7645:0:(genops.c:885:class_export_put()) final put ffff8e792ee56800/353832f0-fe7b-4d99-975c-a8041babed42 00000020:00000080:0.0:1787823500.830469:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e792ee56800/353832f0-fe7b-4d99-975c-a8041babed42 for lustre-OST0001 00000020:00000080:0.0:1787823500.830513:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e792ee56000 for lustre-OST0001 00000001:02000400:3.0:1787823500.984198:0:9249:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.80 00000001:00100000:2.0:1787823501.360383:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 353832f0-fe7b-4d99-975c-a8041babed42 00000020:00000080:2.0:1787823501.360391:0:6710:0:(genops.c:885:class_export_put()) final put ffff8e792ee53800/353832f0-fe7b-4d99-975c-a8041babed42 00000020:00000080:0.0:1787823501.360454:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e792ee53800/353832f0-fe7b-4d99-975c-a8041babed42 for lustre-OST0000 00000020:00000080:0.0:1787823501.360508:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e792ee51800 for lustre-OST0000 00010000:00010000:3.0:1787823501.553345:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823501.803059:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787823501.803082:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922b89e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651846528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787823501.803151:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823501.803217:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651846528 00000100:00100000:3.0:1787823501.803233:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651846528 00000100:00100000:3.0:1787823501.803287:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787823501.803296:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922b89a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651846528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787823501.803328:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787823501.803371:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922b89a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651846528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823501.803377:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1787823501.803396:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787823501.803424:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7922b89e00 x1874668651846528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823517 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823501.803443:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922b89e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651846528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787823502.534144:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823502.534220:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629794816 00000100:00100000:2.0:1787823502.534229:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629794816 00000100:00100000:2.0:1787823502.534279:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 199 00000100:00100000:2.0:1787823502.534287:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+10:2355:x1874668629794816:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787823502.534359:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+10:2355:x1874668629794816:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 72us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823502.534367:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 199 00000100:00100000:1.0:1787823502.535081:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823502.535140:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629794944 00000100:00100000:3.0:1787823502.535145:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629794944 00000100:00100000:3.0:1787823502.535195:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 45 00000100:00100000:3.0:1787823502.535203:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939dc21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+6:2354:x1874668629794944:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787823502.535254:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939dc21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+6:2354:x1874668629794944:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 52us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823502.535261:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 45 00000100:00080000:0.0:1787823502.535316:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787823502.569991:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787823503.477437:0:9347:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.80 00010000:00010000:3.0:1787823503.597548:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787823503.850043:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874668651846784:0@lo:400:kworker.0 00000100:00100000:2.0:1787823503.850102:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823503.850144:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651847296:0@lo:400:kworker.0 00000100:00100000:2.0:1787823503.850163:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823503.850203:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787823503.850210:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3308:1874668651846656:0@lo:400:kworker.0 00000100:00100000:2.0:1787823503.850235:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823503.850250:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874668651847168:0@lo:400:kworker.0 00000100:00100000:2.0:1787823503.850263:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823503.850279:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874668651846912:0@lo:400:kworker.0 00000100:00100000:2.0:1787823503.850314:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823503.850329:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787823503.850333:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651847040:0@lo:400:kworker.0 00000100:00100000:2.0:1787823503.850346:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823503.850366:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651846784 00000100:00100000:2.0:1787823503.850372:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651846784 00000100:00100000:2.0:1787823503.850403:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651847168 00000100:00100000:2.0:1787823503.850405:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651847168 00000100:00100000:2.0:1787823503.850418:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651846912 00000100:00100000:2.0:1787823503.850420:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651846912 00000100:00100000:2.0:1787823503.850432:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787823503.850438:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874668651846784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823503.850476:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874668651846784:12345-0@lo:400:kworker.0 Request processed in 38us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823503.850481:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787823503.850494:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787823503.850497:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874668651847168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823503.850532:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874668651847168:12345-0@lo:400:kworker.0 Request processed in 34us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823503.850539:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787823503.850550:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787823503.850556:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874668651846912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823503.850587:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874668651846912:12345-0@lo:400:kworker.0 Request processed in 31us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823503.850592:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787823503.850624:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651847296 00000100:00100000:2.0:1787823503.850628:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651847296 00000100:00100000:2.0:1787823503.850653:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651847040 00000100:00100000:2.0:1787823503.850656:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651847040 00000100:00100000:2.0:1787823503.850670:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787823503.850675:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926245680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651847296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823503.850704:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926245680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651847296:12345-0@lo:400:kworker.0 Request processed in 29us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823503.850708:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787823503.850715:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787823503.850719:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4cb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651847040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823503.850735:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4cb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651847040:12345-0@lo:400:kworker.0 Request processed in 17us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823503.850738:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787823503.850946:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651846656 00000100:00100000:2.0:1787823503.850951:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651846656 00000100:00100000:2.0:1787823503.850977:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787823503.850983:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3308:x1874668651846656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823503.851012:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3308:x1874668651846656:12345-0@lo:400:kworker.0 Request processed in 31us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823503.851017:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:2.0:1787823503.851045:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787823503.851048:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787823503.851050:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787823503.851071:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e793a4ea1c0 x1874668651847040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823503.851082:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651847040:0@lo:400:kworker.0 00000100:00100000:2.0:1787823503.851089:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874668651846912:0@lo:400:kworker.0 00000100:00100000:2.0:1787823503.851107:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3308:1874668651846656:0@lo:400:kworker.0 00000100:00100000:2.0:1787823503.851113:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874668651847168:0@lo:400:kworker.0 00000100:00100000:2.0:1787823503.851118:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874668651846784:0@lo:400:kworker.0 00010000:00080000:2.0:1787823503.851124:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e793a4ea580 x1874668651847296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823503.851129:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651847296:0@lo:400:kworker.0 00000100:00100000:0.0:1787823504.371532:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922b89e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651847424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787823504.371618:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823504.371727:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651847424 00000100:00100000:3.0:1787823504.371736:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651847424 00000100:00100000:3.0:1787823504.371812:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787823504.371822:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792eb07c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651847424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787823504.371855:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787823504.371900:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792eb07c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651847424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823504.371917:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1787823504.371958:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7922b89e00 x1874668651847424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823520 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823504.371977:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922b89e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651847424:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787823504.618012:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823505.656098:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787823505.849153:0:9444:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.80 00010000:00010000:3.0:1787823506.670465:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823506.922081:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651847552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787823506.922171:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823506.922212:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651847552 00000100:00100000:0.0:1787823506.922222:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651847552 00000100:00100000:0.0:1787823506.922286:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787823506.922323:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922b88f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651847552:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787823506.922347:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1787823506.922361:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787823506.922418:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922b88f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651847552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823506.922424:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1787823506.922641:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e793a4ca1c0 x1874668651847552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823522 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823506.922663:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651847552:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1787823507.475999:0:9494:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Aug 27 05:38:26 EDT 2026 00000100:00100000:0.0:1787823507.654997:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823507.655044:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823507.655095:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629795072 00000100:00100000:2.0:1787823507.655106:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629795072 00000100:00100000:2.0:1787823507.655166:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 201 00000100:00100000:2.0:1787823507.655175:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+10:2355:x1874668629795072:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787823507.655247:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+10:2355:x1874668629795072:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 72us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823507.655263:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 201 00000100:00100000:2.0:1787823507.655296:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629795200 00000100:00100000:2.0:1787823507.655300:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629795200 00000100:00100000:2.0:1787823507.655334:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 49 00000100:00100000:2.0:1787823507.655340:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792eb06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+6:2355:x1874668629795200:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787823507.655369:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792eb06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+6:2355:x1874668629795200:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 29us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823507.655376:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 49 00000100:00080000:3.0:1787823507.657561:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787823507.690190:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823508.715077:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823508.972940:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922b89e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651847680:0@lo:400:kworker.0 00000100:00100000:0.0:1787823508.973010:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823508.973063:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787823508.973069:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ad52940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874668651847808:0@lo:400:kworker.0 00000100:00100000:0.0:1787823508.973110:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823508.973148:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651847680 00000100:00100000:0.0:1787823508.973155:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651847680 00000100:00100000:0.0:1787823508.973203:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787823508.973211:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3307:x1874668651847680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823508.973256:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3307:x1874668651847680:12345-0@lo:400:kworker.0 Request processed in 46us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823508.973262:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787823508.973303:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651847808 00000100:00100000:0.0:1787823508.973306:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651847808 00000100:00100000:0.0:1787823508.973332:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787823508.973338:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792eb05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874668651847808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823508.973369:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792eb05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874668651847808:12345-0@lo:400:kworker.0 Request processed in 31us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823508.973375:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787823508.973428:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ad52940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874668651847808:0@lo:400:kworker.0 00000100:00100000:0.0:1787823508.973438:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922b89e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651847680:0@lo:400:kworker.0 00000100:00100000:3.0:1787823508.976898:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ad512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874668651848192:0@lo:400:kworker.0 00000100:00100000:3.0:1787823508.976976:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823508.977033:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651848192 00000100:00100000:3.0:1787823508.977041:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651848192 00000100:00100000:3.0:1787823508.977097:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787823508.977122:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ad53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874668651848192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823508.977176:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ad53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874668651848192:12345-0@lo:400:kworker.0 Request processed in 58us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823508.977184:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1787823508.977206:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787823508.977249:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ad512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874668651848192:0@lo:400:kworker.0 00000100:00100000:3.0:1787823508.977294:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787823508.977301:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ad512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651848320:0@lo:400:kworker.0 00000100:00100000:3.0:1787823508.977328:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823508.977354:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651848320 00000100:00100000:3.0:1787823508.977358:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651848320 00000100:00100000:3.0:1787823508.977391:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787823508.977397:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ad52580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651848320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823508.977430:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ad52580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651848320:12345-0@lo:400:kworker.0 Request processed in 33us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823508.977437:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1787823508.977451:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787823508.977470:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e791ad512c0 x1874668651848320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823508.977482:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ad512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651848320:0@lo:400:kworker.0 00000100:00100000:2.0:1787823508.977687:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ad50780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651848064:0@lo:400:kworker.0 00000100:00100000:2.0:1787823508.977731:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823508.977776:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787823508.977783:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ad50b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874668651847936:0@lo:400:kworker.0 00000100:00100000:2.0:1787823508.977807:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823508.977839:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651847936 00000100:00100000:2.0:1787823508.977843:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651847936 00000100:00100000:2.0:1787823508.977875:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787823508.977881:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874668651847936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823508.977914:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874668651847936:12345-0@lo:400:kworker.0 Request processed in 34us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823508.977920:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787823508.977950:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ad50b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874668651847936:0@lo:400:kworker.0 00000100:00100000:3.0:1787823508.979231:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651848064 00000100:00100000:3.0:1787823508.979241:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651848064 00000100:00100000:3.0:1787823508.979298:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787823508.979307:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4ca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651848064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823508.979374:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4ca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651848064:12345-0@lo:400:kworker.0 Request processed in 69us (1642us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823508.979381:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1787823508.979401:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787823508.979405:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787823508.979450:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e791ad50780 x1874668651848064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823508.979463:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ad50780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651848064:0@lo:400:kworker.0 00000100:00100000:0.0:1787823509.482952:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ad50780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651848448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787823509.483077:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823509.483195:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651848448 00000100:00100000:3.0:1787823509.483204:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651848448 00000100:00100000:3.0:1787823509.483255:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787823509.483264:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792eb05e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651848448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787823509.483303:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787823509.483346:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792eb05e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651848448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823509.483352:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1787823509.483460:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e791ad50780 x1874668651848448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823525 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823509.483478:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ad50780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651848448:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787823509.750090:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823510.762238:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823511.787467:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823512.044775:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651848576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787823512.044849:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823512.044946:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651848576 00000100:00100000:0.0:1787823512.044954:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651848576 00000100:00100000:0.0:1787823512.045009:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787823512.045019:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922b89e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651848576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787823512.045063:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787823512.045109:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922b89e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651848576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823512.045117:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1787823512.045139:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787823512.045169:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e793a4cad00 x1874668651848576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823528 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823512.045189:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651848576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787823512.788927:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823512.788977:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823512.789001:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629795456 00000100:00100000:1.0:1787823512.789002:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629795328 00000100:00100000:3.0:1787823512.789011:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629795456 00000100:00100000:1.0:1787823512.789011:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629795328 00000100:00100000:3.0:1787823512.789056:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 53 00000100:00100000:1.0:1787823512.789056:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 203 00000100:00100000:3.0:1787823512.789066:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ad512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+6:2353:x1874668629795456:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787823512.789066:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+10:2353:x1874668629795328:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787823512.789142:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+10:2353:x1874668629795328:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 77us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823512.789150:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 203 00000100:00080000:2.0:1787823512.790083:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787823512.791290:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ad512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+6:2353:x1874668629795456:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 2215us (2302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823512.791607:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 53 00010000:00010000:3.0:1787823512.810912:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823513.844798:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823514.091087:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787823514.091161:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787823514.091182:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874668651848832:0@lo:400:kworker.0 00000100:00100000:3.0:1787823514.091311:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823514.091404:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651848832 00000100:00100000:3.0:1787823514.091411:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651848832 00000100:00100000:3.0:1787823514.091465:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787823514.091474:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ad50f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874668651848832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823514.091533:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ad50f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874668651848832:12345-0@lo:400:kworker.0 Request processed in 59us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823514.091540:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787823514.091585:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874668651848832:0@lo:400:kworker.0 00000100:00100000:0.0:1787823514.095223:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3308:1874668651848704:0@lo:400:kworker.0 00000100:00100000:0.0:1787823514.095381:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823514.096365:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874668651848960:0@lo:400:kworker.0 00000100:00100000:2.0:1787823514.096413:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823514.096985:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787823514.096993:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4c8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651849088:0@lo:400:kworker.0 00000100:00100000:2.0:1787823514.097024:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823514.097139:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4c8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651849344:0@lo:400:kworker.0 00000100:00100000:0.0:1787823514.097167:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823514.097195:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787823514.097201:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874668651849216:0@lo:400:kworker.0 00000100:00100000:0.0:1787823514.097227:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823514.097364:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651849088 00000100:00100000:2.0:1787823514.097372:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651849088 00000100:00100000:2.0:1787823514.097415:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651849344 00000100:00100000:2.0:1787823514.097417:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651849344 00000100:00100000:2.0:1787823514.097432:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787823514.097440:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4c9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651849088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823514.097499:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4c9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651849088:12345-0@lo:400:kworker.0 Request processed in 60us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823514.097506:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787823514.097534:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787823514.097541:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793516b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651849344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823514.097568:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793516b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651849344:12345-0@lo:400:kworker.0 Request processed in 28us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823514.097573:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1787823514.097589:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787823514.097593:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787823514.097617:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e793a4c8780 x1874668651849088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823514.097631:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4c8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651849088:0@lo:400:kworker.0 00010000:00080000:0.0:1787823514.097778:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e793a4c8f00 x1874668651849344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823514.097788:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4c8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651849344:0@lo:400:kworker.0 00000100:00100000:0.0:1787823514.097828:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651848960 00000100:00100000:0.0:1787823514.097831:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651848960 00000100:00100000:0.0:1787823514.097857:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651849216 00000100:00100000:0.0:1787823514.097859:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651849216 00000100:00100000:0.0:1787823514.097875:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787823514.097881:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874668651848960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823514.097925:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874668651848960:12345-0@lo:400:kworker.0 Request processed in 44us (1513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823514.097931:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787823514.097942:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787823514.097947:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793516b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874668651849216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823514.097969:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793516b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874668651849216:12345-0@lo:400:kworker.0 Request processed in 23us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823514.097975:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787823514.097993:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874668651849216:0@lo:400:kworker.0 00000100:00080000:2.0:1787823514.098315:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787823514.098335:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874668651848960:0@lo:400:kworker.0 00000100:00100000:3.0:1787823514.098977:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651848704 00000100:00100000:3.0:1787823514.098984:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651848704 00000100:00100000:3.0:1787823514.101221:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787823514.101252:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3308:x1874668651848704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823514.101351:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3308:x1874668651848704:12345-0@lo:400:kworker.0 Request processed in 119us (5970us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823514.101359:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1787823514.101465:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3308:1874668651848704:0@lo:400:kworker.0 00000100:00100000:3.0:1787823514.603235:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787823514.603260:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ad50780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651849472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787823514.603326:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823514.603654:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651849472 00000100:00100000:3.0:1787823514.603661:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651849472 00000100:00100000:3.0:1787823514.603705:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787823514.603714:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ad50b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651849472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787823514.603750:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787823514.603814:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ad50b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651849472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823514.603821:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1787823514.603865:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e791ad50780 x1874668651849472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823530 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823514.603892:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ad50780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651849472:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787823514.858007:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823515.883479:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823516.906155:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787823517.163552:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787823517.163577:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651849600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787823517.163661:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823517.163907:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651849600 00000100:00100000:3.0:1787823517.163917:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651849600 00000100:00100000:3.0:1787823517.163989:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787823517.163999:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4c8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651849600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787823517.164034:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787823517.164086:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4c8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651849600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823517.164094:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1787823517.164138:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e793a4c9680 x1874668651849600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823533 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823517.164159:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651849600:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787823517.164457:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787823517.900033:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823517.900069:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823517.900101:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629795712 00000100:00100000:0.0:1787823517.900109:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629795712 00000100:00100000:0.0:1787823517.900160:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 57 00000100:00100000:0.0:1787823517.900177:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793516bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+6:2355:x1874668629795712:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787823517.900240:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793516bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+6:2355:x1874668629795712:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 65us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823517.900247:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 57 00000100:00100000:2.0:1787823517.904696:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629795584 00000100:00100000:2.0:1787823517.904710:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629795584 00000100:00100000:2.0:1787823517.904804:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 205 00000100:00100000:2.0:1787823517.904814:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+10:2355:x1874668629795584:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787823517.905059:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+10:2355:x1874668629795584:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 245us (5036us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823517.905068:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 205 00000100:00080000:2.0:1787823517.905107:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787823517.930041:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823518.955156:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823519.215931:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7935168f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874668651849984:0@lo:400:kworker.0 00000100:00100000:0.0:1787823519.216004:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823519.216086:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651849984 00000100:00100000:0.0:1787823519.216093:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651849984 00000100:00100000:0.0:1787823519.216149:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787823519.216158:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7920d63c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874668651849984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823519.216222:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7920d63c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874668651849984:12345-0@lo:400:kworker.0 Request processed in 65us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823519.216229:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1787823519.216249:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787823519.216278:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7935168f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874668651849984:0@lo:400:kworker.0 00000100:00100000:0.0:1787823519.216320:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7920d61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651850112:0@lo:400:kworker.0 00000100:00100000:0.0:1787823519.216345:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823519.216379:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651850112 00000100:00100000:0.0:1787823519.216383:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651850112 00000100:00100000:0.0:1787823519.216415:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787823519.216421:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7935168f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651850112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823519.216450:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7935168f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651850112:12345-0@lo:400:kworker.0 Request processed in 30us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823519.216456:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1787823519.216521:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787823519.216554:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7920d61e00 x1874668651850112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823519.216565:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7920d61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651850112:0@lo:400:kworker.0 00000100:00100000:1.0:1787823519.217314:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7935169e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651849728:0@lo:400:kworker.0 00000100:00100000:1.0:1787823519.217358:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823519.217401:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7920d61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874668651850240:0@lo:400:kworker.0 00000100:00100000:1.0:1787823519.217426:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823519.217522:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787823519.217529:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793516b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874668651849856:0@lo:400:kworker.0 00000100:00100000:1.0:1787823519.217554:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823519.217581:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e79360bad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651850368:0@lo:400:kworker.0 00000100:00100000:1.0:1787823519.217604:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823519.217784:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651850240 00000100:00100000:1.0:1787823519.217790:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651850240 00000100:00100000:1.0:1787823519.217829:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651849856 00000100:00100000:1.0:1787823519.217833:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651849856 00000100:00100000:1.0:1787823519.217850:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787823519.217857:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939dc1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874668651850240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823519.217898:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939dc1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874668651850240:12345-0@lo:400:kworker.0 Request processed in 41us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823519.217904:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787823519.217919:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787823519.217924:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874668651849856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823519.217950:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874668651849856:12345-0@lo:400:kworker.0 Request processed in 26us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823519.217955:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787823519.217974:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651850368 00000100:00100000:1.0:1787823519.217978:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651850368 00000100:00100000:1.0:1787823519.218002:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787823519.218008:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939dc2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651850368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823519.218037:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939dc2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651850368:12345-0@lo:400:kworker.0 Request processed in 30us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823519.218043:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787823519.218070:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793516b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874668651849856:0@lo:400:kworker.0 00010000:00080000:1.0:1787823519.218081:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e79360bad00 x1874668651850368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787823519.218102:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e79360bad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651850368:0@lo:400:kworker.0 00000100:00100000:1.0:1787823519.218112:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7920d61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874668651850240:0@lo:400:kworker.0 00000100:00080000:1.0:1787823519.218138:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787823519.218141:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787823519.218448:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651849728 00000100:00100000:0.0:1787823519.218452:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651849728 00000100:00100000:0.0:1787823519.218507:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1787823519.218514:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3307:x1874668651849728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823519.218559:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3307:x1874668651849728:12345-0@lo:400:kworker.0 Request processed in 46us (1200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823519.218566:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1787823519.219005:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7935169e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651849728:0@lo:400:kworker.0 00000100:00100000:1.0:1787823519.722909:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ad52940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651850496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787823519.722977:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823519.726129:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651850496 00000100:00100000:1.0:1787823519.726144:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651850496 00000100:00100000:1.0:1787823519.726618:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787823519.726631:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939dc2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651850496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787823519.726673:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787823519.727413:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939dc2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651850496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 784us (4433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823519.727422:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1787823519.729314:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e791ad52940 x1874668651850496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823535 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823519.729342:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ad52940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651850496:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787823519.983578:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823521.003223:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823522.026130:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787823522.283510:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651850624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787823522.283590:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823522.283691:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651850624 00000100:00100000:2.0:1787823522.283699:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651850624 00000100:00100000:2.0:1787823522.283745:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787823522.283752:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651850624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787823522.283796:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787823522.283830:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651850624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823522.283835:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1787823522.283863:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e793a4cb480 x1874668651850624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823538 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823522.283879:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651850624:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787823522.283982:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1787823522.922142:0:10125:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 05:38:42 (1787823522) === 00000100:00100000:0.0:1787823523.014482:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823523.014560:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823523.014624:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629795968 00000100:00100000:2.0:1787823523.014642:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629795968 00000100:00100000:2.0:1787823523.014735:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 61 00000100:00100000:2.0:1787823523.014749:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79360ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+6:2354:x1874668629795968:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787823523.014883:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79360ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+6:2354:x1874668629795968:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 139us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823523.014892:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 61 00000100:00100000:3.0:1787823523.015125:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629795840 00000100:00100000:3.0:1787823523.015131:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629795840 00000100:00100000:3.0:1787823523.015176:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 207 00000100:00100000:3.0:1787823523.015185:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+10:2354:x1874668629795840:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787823523.015260:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+10:2354:x1874668629795840:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 76us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823523.015271:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 207 00000100:00080000:0.0:1787823523.016988:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787823523.051714:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823523.408124:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823523.408470:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629796096 00000100:00100000:1.0:1787823523.408481:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629796096 00000100:00100000:1.0:1787823523.408587:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 208 00000100:00100000:1.0:1787823523.408599:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+10:8124:x1874668629796096:12345-192.168.202.35@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787823523.408618:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823523.408637:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e793a2f2c00/0x5d1142b83248178f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44623 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823523.408666:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e793a2f2c00/0x5d1142b83248178f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44623 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823523.408694:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e793a2f2c00/0x5d1142b83248178f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44623 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823523.408705:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a2f2c00, rc 0) 00000100:00100000:1.0:1787823523.408810:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+11:8124:x1874668629796096:12345-192.168.202.35@tcp:101:mount.lustre.0 Request processed in 213us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823523.408818:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 208 00000100:00100000:3.0:1787823523.415118:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823523.415234:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629796224 00000100:00100000:0.0:1787823523.415253:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629796224 00000100:00100000:0.0:1787823523.415313:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 209 00000100:00100000:0.0:1787823523.415323:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+11:8124:x1874668629796224:12345-192.168.202.35@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787823523.415836:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+11:8124:x1874668629796224:12345-192.168.202.35@tcp:501:mount.lustre.0 Request processed in 512us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823523.415845:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 209 00000100:00100000:2.0:1787823523.426446:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823523.427710:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629796352 00000100:00100000:1.0:1787823523.427723:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629796352 00000100:00100000:1.0:1787823523.427816:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 210 00000100:00100000:1.0:1787823523.427827:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+11:8124:x1874668629796352:12345-192.168.202.35@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787823523.428380:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+11:8124:x1874668629796352:12345-192.168.202.35@tcp:503:mount.lustre.0 Request processed in 553us (1957us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823523.428389:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 210 00000100:00100000:2.0:1787823523.440652:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823523.440822:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629796480 00000100:00100000:3.0:1787823523.440847:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629796480 00000100:00100000:3.0:1787823523.440902:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 211 00000100:00100000:3.0:1787823523.440913:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+11:8128:x1874668629796480:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787823523.441297:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+11:8128:x1874668629796480:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 384us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823523.441306:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 211 00000100:00100000:3.0:1787823523.468311:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823523.468450:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629796608 00000100:00100000:0.0:1787823523.468470:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629796608 00000100:00100000:0.0:1787823523.468521:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 212 00000100:00100000:0.0:1787823523.468530:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+11:8128:x1874668629796608:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787823523.468817:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+11:8128:x1874668629796608:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 286us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823523.468825:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 212 00000100:00100000:2.0:1787823523.476213:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823523.476377:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629796736 00000100:00100000:1.0:1787823523.476389:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629796736 00000100:00100000:1.0:1787823523.476458:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 213 00000100:00100000:1.0:1787823523.476469:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+11:8124:x1874668629796736:12345-192.168.202.35@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787823523.476489:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823523.476508:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e793a2f3200/0x5d1142b832481796 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe697ab316f4464d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823523.476539:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e793a2f3200/0x5d1142b832481796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4464d expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823523.476550:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e793a2f3200/0x5d1142b832481796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4464d expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823523.476587:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a2f3200, rc 0) 00000100:00100000:1.0:1787823523.476653:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+12:8124:x1874668629796736:12345-192.168.202.35@tcp:101:mount.lustre.0 Request processed in 185us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823523.476660:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 213 00000100:00100000:2.0:1787823523.483054:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823523.483144:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629796864 00000100:00100000:3.0:1787823523.483162:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629796864 00000100:00100000:3.0:1787823523.483220:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 214 00000100:00100000:3.0:1787823523.483232:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+12:8124:x1874668629796864:12345-192.168.202.35@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787823523.483257:0:5831:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787823523.483285:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787823523.483290:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787823523.483293:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787823523.483295:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787823523.489812:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+12:8124:x1874668629796864:12345-192.168.202.35@tcp:256:mount.lustre.0 Request processed in 6572us (6759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823523.489826:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 214 00000100:00100000:2.0:1787823523.493237:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823523.493369:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629796992 00000100:00100000:0.0:1787823523.493380:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629796992 00000100:00100000:0.0:1787823523.493447:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 215 00000100:00100000:0.0:1787823523.493457:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+12:8124:x1874668629796992:12345-192.168.202.35@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787823523.493475:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823523.493495:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7900031c00/0x5d1142b83248179d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44654 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823523.493524:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7900031c00/0x5d1142b83248179d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44654 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823523.493535:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7900031c00/0x5d1142b83248179d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44654 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823523.493545:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7900031c00, rc 0) 00000100:00100000:0.0:1787823523.493727:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+13:8124:x1874668629796992:12345-192.168.202.35@tcp:101:mount.lustre.0 Request processed in 270us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823523.493735:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 215 00000100:00100000:0.0:1787823523.495869:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823523.496402:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629797120 00000100:00100000:2.0:1787823523.496414:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629797120 00000100:00100000:2.0:1787823523.496484:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 216 00000100:00100000:2.0:1787823523.496494:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+13:8124:x1874668629797120:12345-192.168.202.35@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787823523.496848:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+13:8124:x1874668629797120:12345-192.168.202.35@tcp:501:mount.lustre.0 Request processed in 353us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823523.496868:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 216 00000100:00100000:3.0:1787823523.499816:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823523.500803:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629797248 00000100:00100000:0.0:1787823523.500816:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629797248 00000100:00100000:0.0:1787823523.500911:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 217 00000100:00100000:0.0:1787823523.500921:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+13:8124:x1874668629797248:12345-192.168.202.35@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787823523.501164:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+13:8124:x1874668629797248:12345-192.168.202.35@tcp:503:mount.lustre.0 Request processed in 243us (1358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823523.501173:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 217 00000100:00100000:0.0:1787823523.504367:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823523.504874:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629797376 00000100:00100000:1.0:1787823523.504885:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629797376 00000100:00100000:1.0:1787823523.504941:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 218 00000100:00100000:1.0:1787823523.504950:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+13:8132:x1874668629797376:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787823523.505213:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+13:8132:x1874668629797376:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 263us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823523.505221:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 218 00000100:00100000:1.0:1787823523.509512:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823523.510034:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629797504 00000100:00100000:2.0:1787823523.510046:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629797504 00000100:00100000:2.0:1787823523.510106:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 219 00000100:00100000:2.0:1787823523.510130:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+13:8132:x1874668629797504:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787823523.510398:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+13:8132:x1874668629797504:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 269us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823523.510407:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 219 00000100:00100000:3.0:1787823523.513536:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823523.513643:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629797632 00000100:00100000:1.0:1787823523.513653:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629797632 00000100:00100000:1.0:1787823523.513701:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 10 00000100:00100000:1.0:1787823523.513709:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ad50780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2351:x1874668629797632:12345-192.168.202.35@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787823523.513735:0:5840:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9@192.168.202.35@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:1.0:1787823523.513795:0:5840:0:(genops.c:1385:class_connect()) connect: client cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9, cookie 0x5d1142b8324817a4 00000004:00100000:1.0:1787823523.513826:0:5840:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787823523.514082:0:5840:0:(import.c:65:import_set_state_nolock()) ffff8e7908d99000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787823523.514160:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ad50780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+6:2351:x1874668629797632:12345-192.168.202.35@tcp:38:mount.lustre.0 Request processed in 444us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823523.514168:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 10 00000100:00100000:0.0:1787823523.522012:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823523.522047:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823523.523006:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629797760 00000100:00100000:2.0:1787823523.523018:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629797760 00000100:00100000:2.0:1787823523.523093:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629797888 00000100:00100000:2.0:1787823523.523096:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629797888 00000100:00100000:2.0:1787823523.523115:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 11 00000100:00100000:2.0:1787823523.523124:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79360b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+7:0:x1874668629797760:12345-192.168.202.35@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787823523.523176:0:5839:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787823523.523282:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 12 00000100:00100000:3.0:1787823523.523297:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79360b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+7:8124:x1874668629797888:12345-192.168.202.35@tcp:41:mount.lustre.0 00000100:00100000:2.0:1787823523.523306:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79360b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+7:0:x1874668629797760:12345-192.168.202.35@tcp:41:mount.lustre.0 Request processed in 181us (1301us total) trans 0 rc 0/0 00000004:00000024:3.0:1787823523.523315:0:5840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787823523.523315:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 11 00000100:00100000:3.0:1787823523.523357:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79360b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+6:8124:x1874668629797888:12345-192.168.202.35@tcp:41:mount.lustre.0 Request processed in 65us (1308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823523.523366:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 12 00000100:00080000:0.0:1787823523.523543:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787823523.530547:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823523.530650:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629798016 00000100:00100000:1.0:1787823523.530675:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629798016 00000100:00100000:1.0:1787823523.530736:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 13 00000100:00100000:1.0:1787823523.530747:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+6:8124:x1874668629798016:12345-192.168.202.35@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787823523.530874:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+6:8124:x1874668629798016:12345-192.168.202.35@tcp:40:mount.lustre.0 Request processed in 128us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823523.530882:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 13 00000100:00100000:2.0:1787823523.536521:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823523.536564:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823523.536598:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823523.536681:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629798144 00000100:00100000:0.0:1787823523.536691:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629798144 00000100:00100000:0.0:1787823523.536734:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629798272 00000100:00100000:0.0:1787823523.536738:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629798272 00000100:00100000:0.0:1787823523.536752:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 12 00000100:00100000:0.0:1787823523.536784:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4c92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1874668629798144:12345-192.168.202.35@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787823523.536813:0:6687:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9@192.168.202.35@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:0.0:1787823523.536841:0:6687:0:(genops.c:1385:class_connect()) connect: client cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9, cookie 0x5d1142b8324817ab 00002000:00100000:0.0:1787823523.536864:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9/ffff8e793a4bc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787823523.536875:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787823523.537095:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787823523.537128:0:6687:0:(import.c:65:import_set_state_nolock()) ffff8e793a4bb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787823523.537212:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4c92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+6:2351:x1874668629798144:12345-192.168.202.35@tcp:8:mount.lustre.0 Request processed in 451us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823523.537220:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 12 00000100:00100000:0.0:1787823523.537238:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 13 00000100:00100000:0.0:1787823523.537243:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1874668629798272:12345-192.168.202.35@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787823523.537272:0:6687:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9@192.168.202.35@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:0.0:1787823523.537286:0:6687:0:(genops.c:1385:class_connect()) connect: client cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9, cookie 0x5d1142b8324817b2 00002000:00100000:0.0:1787823523.537292:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9/ffff8e793a4b9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787823523.537307:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787823523.537438:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787823523.537454:0:6687:0:(import.c:65:import_set_state_nolock()) ffff8e793a4be800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787823523.537479:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+6:2351:x1874668629798272:12345-192.168.202.35@tcp:8:mount.lustre.0 Request processed in 233us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823523.537485:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 13 00000100:00100000:3.0:1787823523.537825:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629798400 00000100:00100000:3.0:1787823523.537831:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629798400 00000100:00100000:3.0:1787823523.537881:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 1 00000100:00100000:3.0:1787823523.537889:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+6:8124:x1874668629798400:12345-192.168.202.35@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787823523.538054:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787823523.538189:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+6:8124:x1874668629798400:12345-192.168.202.35@tcp:33:mount.lustre.0 Request processed in 301us (1677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823523.538195:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 1 00010000:00010000:3.0:1787823524.074009:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823524.330317:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874668651850880:0@lo:400:kworker.0 00000100:00100000:2.0:1787823524.330332:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651851136:0@lo:400:kworker.0 00000100:00100000:1.0:1787823524.330418:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651850752:0@lo:400:kworker.0 00000100:00100000:3.0:1787823524.330433:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874668651851008:0@lo:400:kworker.0 00000100:00100000:0.0:1787823524.331789:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823524.332005:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651851392:0@lo:400:kworker.0 00000100:00100000:0.0:1787823524.332040:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823524.332087:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651850880 00000100:00100000:0.0:1787823524.332095:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651850880 00000100:00100000:0.0:1787823524.332153:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787823524.332164:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79360b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874668651850880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823524.332232:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79360b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874668651850880:12345-0@lo:400:kworker.0 Request processed in 58us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823524.332239:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787823524.332283:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874668651850880:0@lo:400:kworker.0 00000100:00100000:0.0:1787823524.332314:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651851392 00000100:00100000:0.0:1787823524.332318:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651851392 00000100:00100000:0.0:1787823524.332355:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787823524.332362:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79360bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651851392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823524.332414:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79360bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651851392:12345-0@lo:400:kworker.0 Request processed in 52us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823524.332433:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1787823524.332453:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787823524.332473:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e793a4ea580 x1874668651851392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823524.332484:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651851392:0@lo:400:kworker.0 00000100:00100000:2.0:1787823524.341470:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823524.341667:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651851136 00000100:00100000:0.0:1787823524.341679:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651851136 00000100:00100000:0.0:1787823524.341748:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787823524.341772:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651851136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823524.341852:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651851136:12345-0@lo:400:kworker.0 Request processed in 97us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823524.341860:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787823524.342402:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823524.342457:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874668651851264:0@lo:400:kworker.0 00000100:00100000:1.0:1787823524.342493:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823524.342530:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651851264 00000100:00100000:1.0:1787823524.342534:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651851264 00000100:00100000:1.0:1787823524.342581:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787823524.342589:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939dc12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874668651851264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823524.342629:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939dc12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874668651851264:12345-0@lo:400:kworker.0 Request processed in 41us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823524.343453:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651850752 00000100:00100000:0.0:1787823524.343460:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651850752 00000100:00100000:0.0:1787823524.343495:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787823524.343502:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3307:x1874668651850752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823524.343549:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3307:x1874668651850752:12345-0@lo:400:kworker.0 Request processed in 49us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823524.343556:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787823524.343631:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651850752:0@lo:400:kworker.0 00000100:00100000:0.0:1787823524.343753:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874668651851264:0@lo:400:kworker.0 00000100:00100000:3.0:1787823524.344912:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823524.344978:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651851008 00000100:00100000:3.0:1787823524.344983:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651851008 00000100:00100000:3.0:1787823524.345022:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787823524.345028:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ad52940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874668651851008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823524.345064:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ad52940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874668651851008:12345-0@lo:400:kworker.0 Request processed in 38us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823524.345069:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787823524.345097:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874668651851008:0@lo:400:kworker.0 00000100:00080000:2.0:1787823524.346088:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787823524.346098:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787823524.346139:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e793a4ca580 x1874668651851136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823524.346154:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651851136:0@lo:400:kworker.0 00000100:00100000:1.0:1787823524.346500:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787823524.841998:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e79360b8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651851520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787823524.842099:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823524.842181:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651851520 00000100:00100000:0.0:1787823524.842190:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651851520 00000100:00100000:0.0:1787823524.842233:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787823524.842242:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79360bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651851520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787823524.842266:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787823524.842306:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79360bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651851520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823524.842314:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1787823524.842347:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e79360b8f00 x1874668651851520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823540 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823524.842366:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e79360b8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651851520:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787823525.103232:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823526.132067:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787823526.420311:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9 00000001:00100000:0.0:1787823526.943249:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9 00010000:00010000:1.0:1787823527.146049:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823527.403104:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787823527.403235:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e79360bbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651851648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787823527.403302:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823527.403660:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651851648 00000100:00100000:0.0:1787823527.403672:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651851648 00000100:00100000:0.0:1787823527.403794:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787823527.403813:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926195a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651851648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787823527.403852:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787823527.403902:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926195a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651851648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823527.403910:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1787823527.403944:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e79360bbc00 x1874668651851648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823543 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787823527.403967:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e79360bbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651851648:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787823527.405488:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1787823527.420707:0:5860:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9 00010000:00010000:3.0:1787823528.170788:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823528.652830:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823528.652872:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823528.652900:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823528.652921:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823528.652948:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823528.652987:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629798784 00000100:00100000:0.0:1787823528.652997:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629798784 00000100:00100000:0.0:1787823528.653053:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629798656 00000100:00100000:0.0:1787823528.653056:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629798656 00000100:00100000:0.0:1787823528.653081:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 65 00000100:00100000:0.0:1787823528.653090:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79360ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2352:x1874668629798784:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787823528.653162:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79360ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2352:x1874668629798784:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 73us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823528.653169:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 65 00000100:00100000:0.0:1787823528.653186:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 66 00000100:00100000:0.0:1787823528.653193:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79360ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+6:2352:x1874668629798656:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787823528.653216:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79360ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+6:2352:x1874668629798656:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 25us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823528.653222:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 66 00000100:00100000:0.0:1787823528.653240:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629799040 00000100:00100000:0.0:1787823528.653243:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629799040 00000100:00100000:0.0:1787823528.653265:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629798912 00000100:00100000:0.0:1787823528.653268:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629798912 00000100:00100000:0.0:1787823528.653290:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 37 00000100:00100000:0.0:1787823528.653295:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79360b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2352:x1874668629799040:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787823528.653320:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79360b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2352:x1874668629799040:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 25us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823528.653327:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 37 00000100:00100000:0.0:1787823528.653337:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 38 00000100:00100000:0.0:1787823528.653343:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79360b83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2352:x1874668629798912:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787823528.653362:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79360b83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2352:x1874668629798912:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 21us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823528.653375:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 38 00000100:00080000:0.0:1787823528.653547:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787823528.653551:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787823528.653554:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787823528.656193:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629798528 00000100:00100000:1.0:1787823528.656208:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629798528 00000100:00100000:1.0:1787823528.656272:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 221 00000100:00100000:1.0:1787823528.656282:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+13:2352:x1874668629798528:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787823528.656909:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+13:2352:x1874668629798528:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 624us (4088us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823528.656918:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 221 00010000:00010000:1.0:1787823529.194783:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787823529.251985:0:10320:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg235-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:3.0:1787823529.452110:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874668651851904:0@lo:400:kworker.0 00000100:00100000:2.0:1787823529.452112:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874668651852032:0@lo:400:kworker.0 00000100:00100000:0.0:1787823529.452184:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651851776:0@lo:400:kworker.0 00000100:00100000:3.0:1787823529.454192:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823529.454273:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a49da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651852416:0@lo:400:kworker.0 00000100:00100000:3.0:1787823529.454308:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823529.460935:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651852160:0@lo:400:kworker.0 00000100:00100000:3.0:1787823529.461012:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823529.461709:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651852416 00000100:00100000:0.0:1787823529.461719:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651852416 00000100:00080000:3.0:1787823529.461805:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787823529.461887:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651852160 00000100:00100000:0.0:1787823529.461891:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651852160 00000100:00100000:0.0:1787823529.461916:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787823529.461931:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79261943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651852416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823529.462002:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79261943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651852416:12345-0@lo:400:kworker.0 Request processed in 73us (7693us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823529.462272:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787823529.462284:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79261952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651852160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823529.462324:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79261952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651852160:12345-0@lo:400:kworker.0 Request processed in 45us (1313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823529.462330:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1787823529.462350:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787823529.462464:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e793a4ea1c0 x1874668651852160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823529.462479:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651852160:0@lo:400:kworker.0 00010000:00080000:3.0:1787823529.462516:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e793a49da40 x1874668651852416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823529.462644:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a49da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651852416:0@lo:400:kworker.0 00000100:00100000:3.0:1787823529.464177:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823529.464281:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651851904 00000100:00100000:2.0:1787823529.464289:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651851904 00000100:00100000:2.0:1787823529.464339:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651852032 00000100:00100000:2.0:1787823529.464343:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651852032 00000100:00100000:2.0:1787823529.464397:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787823529.464406:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926196940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874668651851904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823529.464466:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926196940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874668651851904:12345-0@lo:400:kworker.0 Request processed in 61us (10280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823529.464473:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787823529.464487:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787823529.464493:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926196d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874668651852032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823529.464526:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926196d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874668651852032:12345-0@lo:400:kworker.0 Request processed in 33us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823529.464532:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1787823529.464548:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787823529.464581:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874668651851904:0@lo:400:kworker.0 00000100:00100000:2.0:1787823529.464625:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874668651852032:0@lo:400:kworker.0 00000100:00100000:2.0:1787823529.464970:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823529.464993:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651851776 00000100:00100000:2.0:1787823529.464997:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651851776 00000100:00100000:2.0:1787823529.465024:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1787823529.465031:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3307:x1874668651851776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823529.465063:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3307:x1874668651851776:12345-0@lo:400:kworker.0 Request processed in 33us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823529.465084:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1787823529.465126:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651851776:0@lo:400:kworker.0 00000100:00100000:2.0:1787823529.465138:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874668651852288:0@lo:400:kworker.0 00000100:00100000:2.0:1787823529.465167:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823529.465184:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651852288 00000100:00100000:2.0:1787823529.465187:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651852288 00000100:00100000:2.0:1787823529.465213:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787823529.465220:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a49e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874668651852288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823529.465246:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a49e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874668651852288:12345-0@lo:400:kworker.0 Request processed in 27us (79us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823529.465251:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1787823529.465265:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787823529.465281:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874668651852288:0@lo:400:kworker.0 00000100:00100000:0.0:1787823529.469440:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787823529.975449:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7939dc1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651852544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787823529.975541:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823529.975731:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651852544 00000100:00100000:1.0:1787823529.975740:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651852544 00000100:00100000:1.0:1787823529.975819:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787823529.975828:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a49c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651852544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787823529.975866:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787823529.975915:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a49c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651852544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823529.975922:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1787823529.975962:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7939dc1a40 x1874668651852544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823545 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787823529.975982:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7939dc1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651852544:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787823530.218023:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823531.245242:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823532.265905:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823532.530861:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e79360b9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651852672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787823532.530941:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823532.531025:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651852672 00000100:00100000:0.0:1787823532.531033:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651852672 00000100:00100000:0.0:1787823532.531091:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787823532.531100:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79360b8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651852672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787823532.531136:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787823532.531180:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79360b8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651852672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823532.531187:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1787823532.531208:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787823532.531237:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e79360b9e00 x1874668651852672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823548 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823532.531272:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e79360b9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651852672:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787823533.290005:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823533.770678:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823533.770730:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823533.770803:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823533.770828:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823533.770905:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629799168 00000100:00100000:1.0:1787823533.770916:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629799168 00000100:00100000:1.0:1787823533.770980:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 223 00000100:00100000:1.0:1787823533.770990:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+13:2353:x1874668629799168:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787823533.771065:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+13:2353:x1874668629799168:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 76us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823533.771074:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 223 00000100:00100000:2.0:1787823533.771438:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629799296 00000100:00100000:2.0:1787823533.771443:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629799296 00000100:00100000:2.0:1787823533.771499:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629799424 00000100:00100000:2.0:1787823533.771503:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629799424 00000100:00100000:2.0:1787823533.771526:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 70 00000100:00100000:2.0:1787823533.771533:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79360b8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+6:2352:x1874668629799296:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787823533.771573:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79360b8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+6:2352:x1874668629799296:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 40us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823533.771580:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 70 00000100:00100000:2.0:1787823533.771593:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 71 00000100:00100000:2.0:1787823533.771608:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79360bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2353:x1874668629799424:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787823533.771634:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79360bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2353:x1874668629799424:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 27us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823533.771641:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 71 00000100:00080000:1.0:1787823533.771857:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787823533.772034:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629799680 00000100:00100000:3.0:1787823533.772039:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629799680 00000100:00100000:3.0:1787823533.772090:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 41 00000100:00100000:3.0:1787823533.772098:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79360bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2353:x1874668629799680:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787823533.772135:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79360bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2353:x1874668629799680:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 38us (1305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823533.772149:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 41 00000100:00080000:1.0:1787823533.772407:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787823533.772995:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823533.773234:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629799552 00000100:00100000:0.0:1787823533.773240:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629799552 00000100:00100000:0.0:1787823533.773293:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 42 00000100:00100000:0.0:1787823533.773301:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79049c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2352:x1874668629799552:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787823533.773355:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79049c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2352:x1874668629799552:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 55us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823533.773362:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 42 00000100:00080000:1.0:1787823533.773793:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787823534.314365:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823534.580590:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7926194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651852800:0@lo:400:kworker.0 00000100:00100000:0.0:1787823534.580683:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823534.581022:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651852800 00000100:00100000:2.0:1787823534.581030:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651852800 00000100:00100000:2.0:1787823534.581075:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787823534.581084:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3307:x1874668651852800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823534.581156:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7926195680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874668651852928:0@lo:400:kworker.0 00000100:00100000:1.0:1787823534.581188:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823534.581230:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651852928 00000100:00100000:1.0:1787823534.581234:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651852928 00000100:00100000:1.0:1787823534.581280:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787823534.581287:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939dc2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874668651852928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823534.581323:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939dc2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874668651852928:12345-0@lo:400:kworker.0 Request processed in 37us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823534.581358:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787823534.581400:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7926195680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874668651852928:0@lo:400:kworker.0 00000100:00100000:1.0:1787823534.581918:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7926194780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874668651853056:0@lo:400:kworker.0 00000100:00100000:1.0:1787823534.581947:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823534.586868:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3307:x1874668651852800:12345-0@lo:400:kworker.0 Request processed in 5772us (6172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823534.586883:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787823534.590713:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7926194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651852800:0@lo:400:kworker.0 00000100:00100000:0.0:1787823534.590829:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651853056 00000100:00100000:0.0:1787823534.590838:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651853056 00000100:00100000:0.0:1787823534.590924:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787823534.590936:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939dc03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874668651853056:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787823534.591065:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787823534.591190:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7926197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651853184:0@lo:400:kworker.0 00000100:00100000:3.0:1787823534.591237:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823534.594254:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a49d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874668651853312:0@lo:400:kworker.0 00000100:00100000:2.0:1787823534.594316:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823534.594857:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787823534.594864:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a49cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651853440:0@lo:400:kworker.0 00000100:00100000:3.0:1787823534.595267:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651853184 00000100:00100000:3.0:1787823534.595275:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651853184 00000100:00100000:3.0:1787823534.595325:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787823534.595345:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926194f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651853184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823534.595401:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926194f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651853184:12345-0@lo:400:kworker.0 Request processed in 68us (4164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823534.595408:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1787823534.595450:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7926197480 x1874668651853184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823534.595464:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7926197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651853184:0@lo:400:kworker.0 00000100:00100000:0.0:1787823534.608687:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939dc03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874668651853056:12345-0@lo:400:kworker.0 Request processed in 17740us (26726us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823534.608702:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787823534.608738:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651853312 00000100:00100000:0.0:1787823534.608746:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651853312 00000100:00100000:0.0:1787823534.608832:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787823534.608839:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a49ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874668651853312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823534.608916:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a49ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874668651853312:12345-0@lo:400:kworker.0 Request processed in 78us (14601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823534.608922:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1787823534.609000:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787823534.609005:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787823534.609149:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823534.609195:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a49d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874668651853312:0@lo:400:kworker.0 00000100:00100000:2.0:1787823534.609220:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651853440 00000100:00100000:2.0:1787823534.609224:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651853440 00000100:00100000:1.0:1787823534.609507:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7926194780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874668651853056:0@lo:400:kworker.0 00000100:00100000:2.0:1787823534.609750:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787823534.609802:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a49e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651853440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823534.609848:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a49e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651853440:12345-0@lo:400:kworker.0 Request processed in 91us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823534.609854:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1787823534.609870:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787823534.609947:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e793a49cb40 x1874668651853440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787823534.609959:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a49cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651853440:0@lo:400:kworker.0 00000100:00100000:1.0:1787823535.081948:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787823535.081972:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7939dc0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651853568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787823535.082043:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823535.082121:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651853568 00000100:00100000:1.0:1787823535.082134:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651853568 00000100:00100000:1.0:1787823535.082181:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787823535.082189:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939dc0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651853568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787823535.082222:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787823535.082264:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939dc0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651853568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823535.082272:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1787823535.082312:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7939dc0b40 x1874668651853568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823551 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787823535.082354:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7939dc0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651853568:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787823535.340728:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823536.364954:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823537.388116:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787823537.645638:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787823537.645665:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a49d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651853696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787823537.645736:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823537.645822:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651853696 00000100:00100000:2.0:1787823537.645828:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651853696 00000100:00100000:2.0:1787823537.645879:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787823537.645887:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a49c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651853696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787823537.645933:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787823537.645974:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a49c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651853696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823537.645981:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1787823537.646002:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787823537.646038:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e793a49d2c0 x1874668651853696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823553 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823537.646059:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a49d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651853696:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787823538.411716:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823538.885991:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823538.886194:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629799936 00000100:00100000:0.0:1787823538.886205:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629799936 00000100:00100000:0.0:1787823538.886288:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 75 00000100:00080000:2.0:1787823538.886289:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787823538.886332:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926195e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+6:2353:x1874668629799936:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787823538.889814:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926195e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+6:2353:x1874668629799936:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 3502us (3820us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823538.889833:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 75 00000100:00100000:3.0:1787823538.890180:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823538.890404:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629800192 00000100:00100000:2.0:1787823538.890414:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629800192 00000100:00100000:2.0:1787823538.890484:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 45 00000100:00100000:2.0:1787823538.890495:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926197840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2353:x1874668629800192:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787823538.890549:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926197840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2353:x1874668629800192:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 56us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823538.890556:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 45 00000100:00080000:0.0:1787823538.891969:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787823538.892379:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823538.894399:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629799808 00000100:00100000:0.0:1787823538.894417:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629799808 00000100:00100000:0.0:1787823538.894523:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 225 00000100:00100000:0.0:1787823538.894973:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+13:2353:x1874668629799808:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787823538.895063:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+13:2353:x1874668629799808:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 528us (2687us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823538.895071:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 225 00000100:00100000:2.0:1787823538.897986:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823538.898033:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823538.898099:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629800064 00000100:00100000:0.0:1787823538.898109:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629800064 00000100:00100000:0.0:1787823538.898243:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 76 00000100:00080000:2.0:1787823538.898245:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787823538.898254:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a49d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2353:x1874668629800064:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787823538.898373:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a49d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2353:x1874668629800064:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 120us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823538.898381:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 76 00000100:00100000:3.0:1787823538.899896:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629800320 00000100:00100000:3.0:1787823538.899907:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629800320 00000100:00100000:3.0:1787823538.899978:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 46 00000100:00100000:3.0:1787823538.899987:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a49d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2353:x1874668629800320:12345-192.168.202.35@tcp:400:kworker.0 00000100:00080000:2.0:1787823538.900023:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787823538.900056:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a49d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2353:x1874668629800320:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 70us (2022us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823538.900069:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 46 00010000:00010000:1.0:1787823539.434108:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823539.694851:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e79360b83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874668651853952:0@lo:400:kworker.0 00000100:00100000:0.0:1787823539.694929:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823539.694993:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e79360b9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651854464:0@lo:400:kworker.0 00000100:00100000:0.0:1787823539.695030:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823539.695068:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787823539.695075:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e79360b9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3308:1874668651853824:0@lo:400:kworker.0 00000100:00100000:0.0:1787823539.695113:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823539.695134:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e79360bb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874668651854336:0@lo:400:kworker.0 00000100:00100000:0.0:1787823539.695156:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823539.695180:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e79360bbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874668651854080:0@lo:400:kworker.0 00000100:00100000:0.0:1787823539.695203:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823539.695221:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787823539.695225:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e79360b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651854208:0@lo:400:kworker.0 00000100:00100000:0.0:1787823539.695245:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823539.695281:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651853952 00000100:00100000:0.0:1787823539.695304:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651853952 00000100:00100000:0.0:1787823539.695365:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651854336 00000100:00100000:0.0:1787823539.695369:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651854336 00000100:00100000:0.0:1787823539.695392:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651854080 00000100:00100000:0.0:1787823539.695395:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651854080 00000100:00100000:0.0:1787823539.695411:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787823539.695420:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ac843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874668651853952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823539.695490:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ac843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874668651853952:12345-0@lo:400:kworker.0 Request processed in 71us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823539.695515:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787823539.695813:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787823539.695821:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ac87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874668651854336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823539.695853:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ac87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874668651854336:12345-0@lo:400:kworker.0 Request processed in 34us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823539.695860:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787823539.695872:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787823539.695878:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874668651854080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823539.695909:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874668651854080:12345-0@lo:400:kworker.0 Request processed in 31us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823539.695915:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787823539.695934:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651854464 00000100:00100000:0.0:1787823539.695938:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651854464 00000100:00100000:0.0:1787823539.695968:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651854208 00000100:00100000:0.0:1787823539.695971:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651854208 00000100:00100000:0.0:1787823539.695986:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787823539.695991:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ac852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651854464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823539.696084:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ac852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651854464:12345-0@lo:400:kworker.0 Request processed in 91us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823539.696091:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787823539.696103:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787823539.696109:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651854208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823539.696136:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651854208:12345-0@lo:400:kworker.0 Request processed in 28us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823539.696142:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787823539.696170:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651853824 00000100:00100000:0.0:1787823539.696174:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651853824 00000100:00100000:0.0:1787823539.696199:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787823539.696205:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3308:x1874668651853824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823539.696235:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3308:x1874668651853824:12345-0@lo:400:kworker.0 Request processed in 30us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823539.696241:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00080000:0.0:1787823539.696282:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787823539.696299:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787823539.696302:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787823539.696341:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e79360b92c0 x1874668651854208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823539.696358:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e79360b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651854208:0@lo:400:kworker.0 00000100:00100000:0.0:1787823539.696370:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e79360bbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874668651854080:0@lo:400:kworker.0 00000100:00100000:0.0:1787823539.696406:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e79360b9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3308:1874668651853824:0@lo:400:kworker.0 00000100:00100000:0.0:1787823539.696417:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e79360bb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874668651854336:0@lo:400:kworker.0 00000100:00100000:0.0:1787823539.696909:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e79360b83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874668651853952:0@lo:400:kworker.0 00010000:00080000:0.0:1787823539.696933:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e79360b9e00 x1874668651854464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823539.696944:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e79360b9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651854464:0@lo:400:kworker.0 00000100:00100000:0.0:1787823540.202225:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7939dc0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651854592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787823540.202320:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823540.205920:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651854592 00000100:00100000:2.0:1787823540.205939:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651854592 00000100:00100000:2.0:1787823540.206052:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787823540.206068:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651854592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787823540.206124:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787823540.206240:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651854592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 175us (3920us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823540.206248:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1787823540.206480:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7939dc0f00 x1874668651854592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823556 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823540.206541:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7939dc0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651854592:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787823540.457971:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823541.482659:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823542.506995:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823542.761965:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651854720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787823542.762045:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823542.762295:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651854720 00000100:00100000:2.0:1787823542.762304:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651854720 00000100:00080000:0.0:1787823542.762367:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787823542.762368:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787823542.762378:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651854720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787823542.762428:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787823542.762474:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651854720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823542.762481:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1787823542.762499:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e792ec4c000 x1874668651854720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823558 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823542.762519:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651854720:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787823543.532591:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823544.005153:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823544.005197:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823544.005230:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629800832 00000100:00100000:3.0:1787823544.005240:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629800832 00000100:00100000:3.0:1787823544.005309:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629800960 00000100:00100000:3.0:1787823544.005313:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629800960 00000100:00100000:3.0:1787823544.005333:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 14 00000100:00100000:3.0:1787823544.005342:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79261970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2351:x1874668629800832:12345-192.168.202.35@tcp:9:kworker.0 00000020:00000080:3.0:1787823544.005375:0:6687:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d1142b8324817ab 00000100:00080000:3.0:1787823544.005388:0:6687:0:(import.c:65:import_set_state_nolock()) ffff8e793a4bb800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787823544.005440:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787823544.005838:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79261970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+2:2351:x1874668629800832:12345-192.168.202.35@tcp:9:kworker.0 Request processed in 496us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823544.005846:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 14 00000100:00100000:3.0:1787823544.005868:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 15 00000100:00100000:3.0:1787823544.005875:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2351:x1874668629800960:12345-192.168.202.35@tcp:9:kworker.0 00000020:00000080:3.0:1787823544.005887:0:6687:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d1142b8324817b2 00000100:00080000:3.0:1787823544.005893:0:6687:0:(import.c:65:import_set_state_nolock()) ffff8e793a4be800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787823544.005911:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787823544.006083:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+2:2351:x1874668629800960:12345-192.168.202.35@tcp:9:kworker.0 Request processed in 208us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823544.006090:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 15 00000100:00080000:3.0:1787823544.006110:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787823544.006125:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787823544.006135:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823544.006223:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823544.010431:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823544.010485:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823544.010514:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823544.010550:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629800704 00000100:00100000:3.0:1787823544.010559:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629800704 00000100:00100000:3.0:1787823544.010615:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629800576 00000100:00100000:3.0:1787823544.010618:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629800576 00000100:00100000:3.0:1787823544.010640:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 80 00000100:00100000:3.0:1787823544.010650:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926194780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2353:x1874668629800704:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787823544.010723:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926194780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2353:x1874668629800704:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 74us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823544.010730:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 80 00000100:00100000:3.0:1787823544.010747:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 81 00000100:00100000:3.0:1787823544.010753:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+6:2353:x1874668629800576:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787823544.010803:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+6:2353:x1874668629800576:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 50us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823544.010810:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 81 00000100:00080000:3.0:1787823544.010830:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787823544.011106:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629800448 00000100:00100000:0.0:1787823544.011111:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629800448 00000100:00100000:0.0:1787823544.011144:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 227 00000100:00100000:0.0:1787823544.011150:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+13:2353:x1874668629800448:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787823544.011180:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+13:2353:x1874668629800448:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 31us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823544.011186:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 227 00010000:00010000:0.0:1787823544.554953:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787823544.810123:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7939dc2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651854848:0@lo:400:kworker.0 00000100:00100000:2.0:1787823544.810196:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823544.810260:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7939dc1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874668651855360:0@lo:400:kworker.0 00000100:00100000:2.0:1787823544.810300:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823544.810333:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787823544.810340:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7939dc1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874668651854976:0@lo:400:kworker.0 00000100:00100000:2.0:1787823544.810362:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823544.810379:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7920d61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651855488:0@lo:400:kworker.0 00000100:00100000:2.0:1787823544.810411:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823544.810444:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651854848 00000100:00100000:2.0:1787823544.810465:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651854848 00000100:00100000:2.0:1787823544.810513:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787823544.810522:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3307:x1874668651854848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823544.810572:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3307:x1874668651854848:12345-0@lo:400:kworker.0 Request processed in 51us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823544.810579:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787823544.810610:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651855360 00000100:00100000:2.0:1787823544.810614:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651855360 00000100:00100000:2.0:1787823544.810648:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651854976 00000100:00100000:2.0:1787823544.810652:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651854976 00000100:00100000:2.0:1787823544.810669:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787823544.810676:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a49f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874668651855360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823544.810708:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a49f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874668651855360:12345-0@lo:400:kworker.0 Request processed in 33us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823544.810714:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787823544.810725:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787823544.810731:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a49de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874668651854976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823544.810749:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a49de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874668651854976:12345-0@lo:400:kworker.0 Request processed in 20us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823544.810753:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787823544.810791:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651855488 00000100:00100000:2.0:1787823544.810794:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651855488 00000100:00100000:2.0:1787823544.810814:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787823544.810818:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a49fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651855488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823544.810837:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a49fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651855488:12345-0@lo:400:kworker.0 Request processed in 20us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823544.810841:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1787823544.810859:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787823544.810862:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787823544.810891:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7939dc1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874668651854976:0@lo:400:kworker.0 00010000:00080000:2.0:1787823544.810900:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7920d61e00 x1874668651855488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823544.810907:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7920d61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651855488:0@lo:400:kworker.0 00000100:00100000:2.0:1787823544.810912:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7939dc2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651854848:0@lo:400:kworker.0 00000100:00100000:2.0:1787823544.810917:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7939dc1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874668651855360:0@lo:400:kworker.0 00000100:00100000:0.0:1787823544.811202:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7939dc0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651855232:0@lo:400:kworker.0 00000100:00100000:0.0:1787823544.811235:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823544.811280:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787823544.811287:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7939dc0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874668651855104:0@lo:400:kworker.0 00000100:00100000:0.0:1787823544.811305:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823544.811332:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651855104 00000100:00100000:0.0:1787823544.811336:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651855104 00000100:00100000:0.0:1787823544.811374:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787823544.811380:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874668651855104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823544.811415:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874668651855104:12345-0@lo:400:kworker.0 Request processed in 36us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823544.811419:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1787823544.811431:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787823544.811442:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7939dc0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874668651855104:0@lo:400:kworker.0 00000100:00100000:2.0:1787823544.811650:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651855232 00000100:00100000:2.0:1787823544.811654:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651855232 00000100:00080000:0.0:1787823544.811742:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787823544.812119:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787823544.812128:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651855232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823544.812171:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651855232:12345-0@lo:400:kworker.0 Request processed in 46us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823544.812174:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1787823544.812226:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7939dc0b40 x1874668651855232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823544.812237:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7939dc0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651855232:0@lo:400:kworker.0 00000100:00100000:3.0:1787823545.322063:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a49f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651855616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787823545.322151:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823545.322351:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651855616 00000100:00100000:0.0:1787823545.322359:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651855616 00000100:00100000:0.0:1787823545.322416:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787823545.322426:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926197c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651855616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787823545.322462:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787823545.322739:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926197c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651855616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 313us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823545.322748:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1787823545.323346:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e793a49f840 x1874668651855616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823561 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823545.323369:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a49f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651855616:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787823545.577842:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823546.604907:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787823546.960157:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9 00000020:00000080:3.0:1787823546.960169:0:7645:0:(genops.c:885:class_export_put()) final put ffff8e793a4b9800/cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9 00000020:00000080:0.0:1787823546.961652:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e793a4b9800/cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9 for lustre-OST0001 00000020:00000080:3.0:1787823546.965330:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e793a4be800 for lustre-OST0001 00000001:00100000:0.0:1787823547.468310:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9 00000020:00000080:0.0:1787823547.468318:0:6710:0:(genops.c:885:class_export_put()) final put ffff8e793a4bc000/cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9 00000020:00000080:1.0:1787823547.468541:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e793a4bc000/cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9 for lustre-OST0000 00000020:00000080:1.0:1787823547.468660:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e793a4bb800 for lustre-OST0000 00010000:00010000:3.0:1787823547.626008:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823547.884200:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7920d61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651855744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787823547.884326:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823547.884444:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651855744 00000100:00100000:1.0:1787823547.884458:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651855744 00000100:00100000:1.0:1787823547.884549:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787823547.884562:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79351692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651855744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787823547.884629:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787823547.884688:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79351692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651855744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823547.884696:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1787823547.884723:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787823547.885077:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7920d61e00 x1874668651855744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823563 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787823547.885124:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7920d61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651855744:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787823548.657334:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787823548.675602:0:11022:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1787823549.138219:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823549.138266:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823549.138298:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823549.138330:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629801344 00000100:00100000:3.0:1787823549.138339:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629801344 00000100:00100000:3.0:1787823549.138404:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629801216 00000100:00100000:3.0:1787823549.138408:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629801216 00000100:00100000:3.0:1787823549.138430:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 85 00000100:00100000:3.0:1787823549.138439:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926195680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2352:x1874668629801344:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787823549.138510:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926195680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2352:x1874668629801344:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 72us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823549.138517:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 85 00000100:00100000:3.0:1787823549.138532:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 86 00000100:00100000:3.0:1787823549.138537:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79261952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+6:2352:x1874668629801216:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787823549.138557:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79261952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+6:2352:x1874668629801216:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 20us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823549.138562:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 86 00000100:00100000:1.0:1787823549.138742:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629801088 00000100:00100000:1.0:1787823549.138746:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629801088 00000100:00100000:1.0:1787823549.138827:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 229 00000100:00100000:1.0:1787823549.138834:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+13:2352:x1874668629801088:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787823549.138873:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+13:2352:x1874668629801088:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 39us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823549.138879:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 229 00000100:00080000:1.0:1787823549.138906:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787823549.673920:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823549.931042:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e79360b9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874668651856000:0@lo:400:kworker.0 00000100:00100000:0.0:1787823549.931127:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823549.931185:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e79360bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651856512:0@lo:400:kworker.0 00000100:00100000:0.0:1787823549.931225:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823549.931264:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787823549.931270:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e79360bb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3308:1874668651855872:0@lo:400:kworker.0 00000100:00100000:0.0:1787823549.931305:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823549.931328:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e79360b9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874668651856384:0@lo:400:kworker.0 00000100:00100000:0.0:1787823549.931349:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823549.931377:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e79360bbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874668651856128:0@lo:400:kworker.0 00000100:00100000:0.0:1787823549.931399:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823549.931417:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787823549.931421:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e79360b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651856256:0@lo:400:kworker.0 00000100:00100000:0.0:1787823549.931441:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823549.931473:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651856000 00000100:00100000:0.0:1787823549.931481:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651856000 00000100:00100000:0.0:1787823549.931526:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651856384 00000100:00100000:0.0:1787823549.931530:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651856384 00000100:00100000:0.0:1787823549.931554:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651856128 00000100:00100000:0.0:1787823549.931557:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651856128 00000100:00100000:0.0:1787823549.931575:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787823549.931583:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874668651856000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823549.931634:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874668651856000:12345-0@lo:400:kworker.0 Request processed in 52us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823549.931654:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787823549.931670:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787823549.931677:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790aef30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874668651856384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823549.931717:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790aef30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874668651856384:12345-0@lo:400:kworker.0 Request processed in 41us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823549.931723:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787823549.931735:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787823549.931741:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790aef3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874668651856128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823549.931798:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790aef3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874668651856128:12345-0@lo:400:kworker.0 Request processed in 57us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823549.931805:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787823549.931823:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651855872 00000100:00100000:0.0:1787823549.931827:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651855872 00000100:00100000:0.0:1787823549.931854:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787823549.931861:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3308:x1874668651855872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823549.931891:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3308:x1874668651855872:12345-0@lo:400:kworker.0 Request processed in 30us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823549.931898:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787823549.931935:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651856512 00000100:00100000:0.0:1787823549.931938:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651856512 00000100:00100000:0.0:1787823549.931965:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651856256 00000100:00100000:0.0:1787823549.931967:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651856256 00000100:00100000:0.0:1787823549.931981:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787823549.931987:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790aef1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651856512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823549.932017:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790aef1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651856512:12345-0@lo:400:kworker.0 Request processed in 31us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823549.932022:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787823549.932032:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787823549.932037:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790aef0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651856256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823549.932073:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790aef0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651856256:12345-0@lo:400:kworker.0 Request processed in 36us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823549.932080:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1787823549.932096:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787823549.932100:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787823549.932103:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787823549.932136:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e79360b92c0 x1874668651856256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823549.932151:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e79360b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651856256:0@lo:400:kworker.0 00000100:00100000:0.0:1787823549.932162:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e79360bbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874668651856128:0@lo:400:kworker.0 00000100:00100000:0.0:1787823549.932190:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e79360bb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3308:1874668651855872:0@lo:400:kworker.0 00000100:00100000:0.0:1787823549.932213:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e79360b9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874668651856384:0@lo:400:kworker.0 00000100:00100000:0.0:1787823549.932223:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e79360b9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874668651856000:0@lo:400:kworker.0 00010000:00080000:0.0:1787823549.932232:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e79360bb480 x1874668651856512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823549.932240:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e79360bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651856512:0@lo:400:kworker.0 00000100:00100000:2.0:1787823550.442964:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787823550.442997:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a49e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651856640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787823550.443072:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823550.443384:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651856640 00000100:00100000:1.0:1787823550.443393:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651856640 00000100:00100000:1.0:1787823550.443454:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787823550.443465:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a49f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651856640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787823550.443511:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787823550.443593:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a49f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651856640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823550.443601:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1787823550.443747:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e793a49e1c0 x1874668651856640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823566 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823550.443796:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a49e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651856640:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787823550.703850:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823551.722278:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823552.754680:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823553.002550:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787823553.002577:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793516a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651856768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787823553.002658:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823553.002869:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651856768 00000100:00100000:1.0:1787823553.002879:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651856768 00000100:00100000:1.0:1787823553.002954:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787823553.002966:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79360b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651856768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787823553.003013:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787823553.003064:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79360b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651856768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823553.003082:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1787823553.003127:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e793516a940 x1874668651856768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823569 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787823553.003146:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793516a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651856768:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787823553.003586:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1787823553.065591:0:11170:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcb84e02c0 20000000:00000080:2.0:1787823553.065612:0:11170:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e793a4af000 uarg=0000000000000000 20000000:01000000:2.0:1787823553.065658:0:11170:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787823553.065664:0:11170:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787823553.065670:0:11170:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787823553.068481:0:11171:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1787823553.068645:0:11170:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787823553.075816:0:11170:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787823553.075856:0:11170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e7920eeac00/0x5d1142b8324817b9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823553.075881:0:11170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e79358d3800/0x5d1142b83248175e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4461c expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823553.075900:0:11170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e79358d2200/0x5d1142b83248176c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832481765 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823553.075908:0:11170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e79358d2e00/0x5d1142b83248177a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832481773 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823553.075915:0:11170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7900030000/0x5d1142b832481788 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832481781 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823553.075922:0:11170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7900031c00/0x5d1142b83248179d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44654 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823553.075930:0:11170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e7920eeac00/0x5d1142b8324817b9 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823553.075975:0:11170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7900031c00/0x5d1142b83248179d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44654 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823553.075992:0:11170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e7900031c00/0x5d1142b83248179d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44654 expref: 12 pid: 5832 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823553.076008:0:11170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7926194b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1874668651856896:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787823553.077815:0:11170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7900030000/0x5d1142b832481788 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d1142b832481781 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823553.077831:0:11170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e7900030000/0x5d1142b832481788 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d1142b832481781 expref: 18 pid: 5833 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823553.077845:0:11170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e79261961c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1874668651857024:0@lo:104: 00000100:00100000:3.0:1787823553.077891:0:11170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787823553.077950:0:11170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e79358d2e00/0x5d1142b83248177a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d1142b832481773 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823553.077959:0:11170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e79358d2e00/0x5d1142b83248177a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d1142b832481773 expref: 18 pid: 5832 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823553.077967:0:11170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4e9e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1874668651857152:0@lo:104: 00000100:00100000:3.0:1787823553.077990:0:11170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823553.078007:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651857024 00010000:00010000:3.0:1787823553.078011:0:11170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e79358d2200/0x5d1142b83248176c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d1142b832481765 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823553.078019:0:11170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e79358d2200/0x5d1142b83248176c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d1142b832481765 expref: 18 pid: 5832 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823553.078024:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651857024 00000100:00100000:3.0:1787823553.078043:0:11170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4e8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1874668651857280:0@lo:104: 00000100:00100000:3.0:1787823553.078062:0:11170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823553.078064:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651857152 00000100:00100000:2.0:1787823553.078067:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651857152 00000100:00100000:2.0:1787823553.078078:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651857280 00010000:00010000:3.0:1787823553.078081:0:11170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e79358d3800/0x5d1142b83248175e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4461c expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823553.078081:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651857280 00010000:00010000:3.0:1787823553.078091:0:11170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e79358d3800/0x5d1142b83248175e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4461c expref: 12 pid: 5832 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823553.078094:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787823553.078102:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926196580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+5:11170:x1874668651857024:12345-0@lo:104: 00000100:00100000:3.0:1787823553.078112:0:11170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4ea580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1874668651857408:192.168.202.35@tcp:104: 00010000:00010000:2.0:1787823553.078114:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff8e7900030400/0x5d1142b832481781 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b832481788 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823553.078158:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787823553.078165:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926196580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+5:11170:x1874668651857024:12345-0@lo:104: Request processed in 63us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823553.078182:0:11170:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a79d900 going to sleep for 11 seconds 00000100:00100000:2.0:1787823553.078184:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787823553.078207:0:11170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e79261961c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1874668651857024:0@lo:104: 00000100:00100000:2.0:1787823553.078212:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787823553.078219:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4eb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+4:11170:x1874668651857152:12345-0@lo:104: 00010000:00010000:2.0:1787823553.078226:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff8e793a2f2200/0x5d1142b832481773 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b83248177a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823553.078277:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787823553.078283:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4eb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+4:11170:x1874668651857152:12345-0@lo:104: Request processed in 66us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823553.078288:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787823553.078300:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787823553.078306:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+3:11170:x1874668651857280:12345-0@lo:104: 00010000:00010000:2.0:1787823553.078313:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff8e7920eebc00/0x5d1142b832481765 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b83248176c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823553.078344:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787823553.078354:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+3:11170:x1874668651857280:12345-0@lo:104: Request processed in 49us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823553.078360:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1787823553.078380:0:7629:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787823553.078386:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e7900030400/0x5d1142b832481781 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b832481788 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823553.078393:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7900030400 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:2.0:1787823553.078398:0:7629:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e7900030400/0x5d1142b832481781 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d1142b832481788 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823553.078407:0:7629:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e7900030400/0x5d1142b832481781 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d1142b832481788 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787823553.078414:0:7629:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e7900030400/0x5d1142b832481781 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d1142b832481788 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787823553.078421:0:7629:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787823553.078447:0:7629:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e7900030400/0x5d1142b832481781 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832481788 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823553.078453:0:7629:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787823553.078471:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e7900030400/0x5d1142b832481781 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832481788 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823553.078479:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e7900030400/0x5d1142b832481781 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832481788 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823553.078492:0:7629:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787823553.078495:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e793a2f2200/0x5d1142b832481773 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b83248177a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823553.078511:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f2200 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:2.0:1787823553.078514:0:7629:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e793a2f2200/0x5d1142b832481773 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d1142b83248177a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823553.078520:0:7629:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e793a2f2200/0x5d1142b832481773 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d1142b83248177a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787823553.078525:0:7629:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e793a2f2200/0x5d1142b832481773 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d1142b83248177a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787823553.078530:0:7629:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787823553.078545:0:7629:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e793a2f2200/0x5d1142b832481773 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b83248177a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823553.078551:0:7629:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787823553.078557:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e793a2f2200/0x5d1142b832481773 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b83248177a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823553.078562:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e793a2f2200/0x5d1142b832481773 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b83248177a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823553.078571:0:7629:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787823553.078574:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e7920eebc00/0x5d1142b832481765 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b83248176c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823553.078580:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eebc00 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:2.0:1787823553.078582:0:7629:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e7920eebc00/0x5d1142b832481765 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d1142b83248176c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823553.078598:0:7629:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e7920eebc00/0x5d1142b832481765 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d1142b83248176c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787823553.078605:0:7629:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e7920eebc00/0x5d1142b832481765 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d1142b83248176c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787823553.078610:0:7629:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787823553.078623:0:7629:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e7920eebc00/0x5d1142b832481765 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b83248176c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823553.078629:0:7629:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787823553.078643:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e7920eebc00/0x5d1142b832481765 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b83248176c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823553.078650:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e7920eebc00/0x5d1142b832481765 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b83248176c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823553.078664:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823553.078666:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823553.078667:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823553.078673:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787823553.078683:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a49f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651857536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787823553.078715:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823553.078737:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787823553.078743:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a49c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651857664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787823553.078782:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823553.078802:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787823553.078809:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a49cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651857792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787823553.078838:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823553.078861:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651857536 00000100:00100000:2.0:1787823553.078866:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651857536 00010000:00010000:2.0:1787823553.078885:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7900030000/0x5d1142b832481788 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b832481781 expref: 19 pid: 5833 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823553.078902:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651857664 00000100:00100000:2.0:1787823553.078905:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651857664 00010000:00010000:2.0:1787823553.078914:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e79358d2e00/0x5d1142b83248177a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b832481773 expref: 20 pid: 5832 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823553.078927:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651857792 00000100:00100000:2.0:1787823553.078929:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651857792 00010000:00010000:2.0:1787823553.078937:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e79358d2200/0x5d1142b83248176c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b832481765 expref: 21 pid: 5832 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823553.078947:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787823553.078953:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909a21050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+21:3307:x1874668651857536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787823553.078965:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787823553.078971:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7900030000/0x5d1142b832481788 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b832481781 expref: 21 pid: 5833 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823553.078979:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7900030000/0x5d1142b832481788 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d1142b832481781 expref: 21 pid: 5833 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823553.078991:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7900030000/0x5d1142b832481788 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d1142b832481781 expref: 21 pid: 5833 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823553.079005:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787823553.079029:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909a21050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+20:3307:x1874668651857536:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823553.079043:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787823553.079081:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787823553.079086:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a49da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3307:x1874668651857664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787823553.079093:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787823553.079097:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e79358d2e00/0x5d1142b83248177a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b832481773 expref: 19 pid: 5832 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823553.079104:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e79358d2e00/0x5d1142b83248177a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d1142b832481773 expref: 19 pid: 5832 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823553.079113:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787823553.079130:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a49da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3307:x1874668651857664:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823553.079135:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787823553.079144:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787823553.079148:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a49cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:3306:x1874668651857792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787823553.079154:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787823553.079157:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e79358d2200/0x5d1142b83248176c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b832481765 expref: 18 pid: 5832 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823553.079164:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e79358d2200/0x5d1142b83248176c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d1142b832481765 expref: 18 pid: 5832 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823553.079185:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787823553.079207:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a49cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:3306:x1874668651857792:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823553.079212:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787823553.079248:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a49cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651857792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787823553.079277:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a49c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651857664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787823553.079283:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a49f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651857536:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787823553.079360:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823553.079530:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e79358d2e00/0x5d1142b83248177a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d1142b832481773 expref: 17 pid: 5832 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823553.079540:0:11170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4e9e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1874668651857152:0@lo:104: 00010000:00010000:3.0:1787823553.079549:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e79358d2200/0x5d1142b83248176c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d1142b832481765 expref: 16 pid: 5832 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823553.079556:0:11170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4e8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1874668651857280:0@lo:104: 00000100:00100000:0.0:1787823553.084915:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823553.084969:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823553.085020:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629801472 00000100:00100000:0.0:1787823553.085030:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629801472 00010000:00010000:0.0:1787823553.085076:0:7631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7900031c00/0x5d1142b83248179d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44654 expref: 13 pid: 5832 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823553.085107:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629801600 00000100:00100000:0.0:1787823553.085110:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629801600 00010000:00010000:0.0:1787823553.085122:0:7631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e79358d3800/0x5d1142b83248175e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4461c expref: 14 pid: 5832 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823553.085142:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 28 00000100:00100000:0.0:1787823553.085151:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79360b9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:29690577-71bc-48f4-b24d-bdb875faaf85+14:2352:x1874668629801472:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787823553.085167:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787823553.085184:0:7631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7900031c00/0x5d1142b83248179d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44654 expref: 14 pid: 5832 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823553.085198:0:7631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7900031c00/0x5d1142b83248179d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44654 expref: 14 pid: 5832 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823553.085219:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787823553.085283:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79360b9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:29690577-71bc-48f4-b24d-bdb875faaf85+14:2352:x1874668629801472:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 133us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823553.085291:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 28 00000100:00100000:0.0:1787823553.085311:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 29 00000100:00100000:0.0:1787823553.085317:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79360bb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:29690577-71bc-48f4-b24d-bdb875faaf85+13:2352:x1874668629801600:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787823553.085325:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787823553.085330:0:7631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e79358d3800/0x5d1142b83248175e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4461c expref: 13 pid: 5832 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823553.085349:0:7631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e79358d3800/0x5d1142b83248175e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4461c expref: 13 pid: 5832 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823553.085362:0:7631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e7920eeac00/0x5d1142b8324817b9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823553.085371:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7920eeac00/0x5d1142b8324817b9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823553.085387:0:7631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7920eeac00/0x5d1142b8324817b9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823553.085393:0:7631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7920eeac00/0x5d1142b8324817b9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823553.085400:0:7631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e7920eeac00/0x5d1142b8324817b9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823553.085406:0:7631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e7920eeac00/0x5d1142b8324817b9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823553.085412:0:7631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eeac00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:0.0:1787823553.085415:0:7631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e7920eeac00/0x5d1142b8324817b9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823553.085423:0:7631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e7920eeac00/0x5d1142b8324817b9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823553.085431:0:7631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e7920eeac00/0x5d1142b8324817b9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823553.085451:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787823553.085472:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79360bb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:29690577-71bc-48f4-b24d-bdb875faaf85+13:2352:x1874668629801600:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 155us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823553.085479:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 29 00010000:00010000:2.0:1787823553.086322:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7900031c00/0x5d1142b83248179d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44654 expref: 12 pid: 5832 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823553.086342:0:11170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7926194b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1874668651856896:192.168.202.35@tcp:104: 00010000:00010000:2.0:1787823553.086356:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e79358d3800/0x5d1142b83248175e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4461c expref: 11 pid: 5832 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823553.086364:0:11170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4ea580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1874668651857408:192.168.202.35@tcp:104: 00010000:00010000:2.0:1787823553.086398:0:11170:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e7920eeac00/0x5d1142b8324817b9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823553.086408:0:11170:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e7920eeac00/0x5d1142b8324817b9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823553.086414:0:11170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e7920eeac00/0x5d1142b8324817b9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823553.086420:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7920eeac00/0x5d1142b8324817b9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823553.771890:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823554.252206:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823554.252254:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823554.252321:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823554.252353:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629801856 00000100:00100000:1.0:1787823554.252363:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629801856 00000100:00100000:1.0:1787823554.252421:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629801984 00000100:00100000:1.0:1787823554.252425:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629801984 00000100:00100000:1.0:1787823554.252868:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 90 00000100:00100000:1.0:1787823554.252883:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793516a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+6:2352:x1874668629801856:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787823554.252965:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793516a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+6:2352:x1874668629801856:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 87us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823554.252973:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 90 00000100:00100000:1.0:1787823554.252992:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 91 00000100:00100000:1.0:1787823554.252998:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7935169a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2352:x1874668629801984:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787823554.253020:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7935169a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2352:x1874668629801984:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 22us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823554.253026:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 91 00000100:00080000:1.0:1787823554.253044:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787823554.253412:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629801728 00000100:00100000:2.0:1787823554.253418:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629801728 00000100:00100000:2.0:1787823554.253594:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 231 00000100:00100000:2.0:1787823554.253603:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+11:2352:x1874668629801728:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787823554.253634:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+11:2352:x1874668629801728:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 33us (1380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823554.253662:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 231 00000100:00100000:0.0:1787823554.375055:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823554.376558:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629802112 00000100:00100000:1.0:1787823554.376586:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629802112 00000100:00100000:1.0:1787823554.376749:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 232 00000100:00100000:1.0:1787823554.376796:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+11:5595:x1874668629802112:12345-192.168.202.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787823554.376818:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823554.376841:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e793a2f2600/0x5d1142b8324817c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe697ab316f4467e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823554.376945:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e793a2f2600/0x5d1142b8324817c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4467e expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823554.376957:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e793a2f2600/0x5d1142b8324817c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4467e expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823554.376967:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a2f2600, rc 0) 00000100:00100000:1.0:1787823554.377054:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+12:5595:x1874668629802112:12345-192.168.202.35@tcp:101:ll_cfg_requeue.0 Request processed in 262us (2012us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823554.377063:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 232 00000100:00100000:1.0:1787823554.384345:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823554.388986:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629802240 00000100:00100000:2.0:1787823554.389004:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629802240 00000100:00100000:2.0:1787823554.389091:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 233 00000100:00100000:2.0:1787823554.389105:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+12:5595:x1874668629802240:12345-192.168.202.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787823554.398367:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+12:5595:x1874668629802240:12345-192.168.202.35@tcp:501:ll_cfg_requeue.0 Request processed in 9251us (14023us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823554.398385:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 233 00000100:00100000:0.0:1787823554.405354:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823554.405693:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629802368 00000100:00100000:3.0:1787823554.405706:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629802368 00000100:00100000:3.0:1787823554.405786:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 234 00000100:00100000:3.0:1787823554.405796:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+12:5595:x1874668629802368:12345-192.168.202.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787823554.406862:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+12:5595:x1874668629802368:12345-192.168.202.35@tcp:503:ll_cfg_requeue.0 Request processed in 1057us (1512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823554.406875:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 234 10000000:01000000:2.0:1787823554.417743:0:5835:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787823554.417753:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e7903710800 from 7 10000000:01000000:2.0:1787823554.417771:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787823554.417826:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e79358d3a00/0x5d1142b8324817c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823554.417838:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e79358d3a00/0x5d1142b8324817c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823554.417850:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e79358d3a00/0x5d1142b8324817c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823554.418053:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a49c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651857920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787823554.418116:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823554.418543:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e792ec58000 going to sleep for 11 seconds 00000100:00100000:0.0:1787823554.419491:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651857920 00000100:00100000:0.0:1787823554.419500:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651857920 00000100:00100000:0.0:1787823554.419556:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1787823554.419576:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+16:5835:x1874668651857920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787823554.419592:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823554.419609:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e79013a3800/0x5d1142b8324817ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b8324817c7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823554.419635:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e79013a3800/0x5d1142b8324817ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b8324817c7 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823554.419647:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e79013a3800/0x5d1142b8324817ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b8324817c7 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823554.419657:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79013a3800, rc 0) 00000100:00100000:0.0:1787823554.419719:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:5835:x1874668651857920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (1601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823554.419735:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787823554.420307:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a49c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651857920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787823554.420331:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e79358d3a00/0x5d1142b8324817c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324817ce expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823554.420341:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e79358d3a00/0x5d1142b8324817c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b8324817ce expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823554.420421:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a49c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651858048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787823554.420950:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823554.420984:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e792ec58000 going to sleep for 11 seconds 00000100:00100000:3.0:1787823554.422718:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651858048 00000100:00100000:3.0:1787823554.422736:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651858048 00000100:00100000:3.0:1787823554.424716:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787823554.424737:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:5835:x1874668651858048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787823554.425091:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:5835:x1874668651858048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 361us (4142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823554.425100:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787823554.425778:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a49c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651858048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787823554.425851:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a49c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651858176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787823554.425914:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823554.426381:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e792ec58000 going to sleep for 11 seconds 00000100:00100000:0.0:1787823554.426417:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651858176 00000100:00100000:0.0:1787823554.426424:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651858176 00000100:00100000:1.0:1787823554.426724:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787823554.426734:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:5835:x1874668651858176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787823554.427246:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:5835:x1874668651858176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 511us (1329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823554.427255:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787823554.427362:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a49c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651858176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787823554.429005:0:11190:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787823554.430790:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787823554.430826:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787823554.430840:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e79358d3a00/0x5d1142b8324817c7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324817ce expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823554.430864:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e79358d3a00/0x5d1142b8324817c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324817ce expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787823554.430878:0:5835:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787823554.430881:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e7909bc2800 from 7 10000000:01000000:2.0:1787823554.430884:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787823554.430930:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e79358d2a00/0x5d1142b8324817d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823554.430938:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e79358d2a00/0x5d1142b8324817d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823554.430948:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e79358d2a00/0x5d1142b8324817d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823554.430974:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a49c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651858304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787823554.431068:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823554.431119:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e792ec58000 going to sleep for 11 seconds 00000100:00100000:1.0:1787823554.431417:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651858304 00000100:00100000:1.0:1787823554.431427:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651858304 00000100:00100000:1.0:1787823554.431501:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787823554.431513:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:5835:x1874668651858304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787823554.431538:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823554.431554:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e793a2f3600/0x5d1142b8324817dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b8324817d5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823554.431859:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e793a2f3600/0x5d1142b8324817dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b8324817d5 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823554.431871:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e793a2f3600/0x5d1142b8324817dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b8324817d5 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823554.431881:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a2f3600, rc 0) 00000100:00100000:1.0:1787823554.431939:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:5835:x1874668651858304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 428us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823554.431947:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787823554.432245:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a49c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651858304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787823554.432263:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e79358d2a00/0x5d1142b8324817d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324817dc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823554.432273:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e79358d2a00/0x5d1142b8324817d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b8324817dc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823554.432342:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a49c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651858432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787823554.432376:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823554.432411:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e792ec58000 going to sleep for 11 seconds 00000100:00100000:1.0:1787823554.432697:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651858432 00000100:00100000:1.0:1787823554.432703:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651858432 00000100:00100000:1.0:1787823554.432745:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787823554.432753:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:5835:x1874668651858432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787823554.433428:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:5835:x1874668651858432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 673us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823554.433437:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787823554.433723:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a49c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651858432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787823554.433792:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e79360bbc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651858560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787823554.433842:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823554.433887:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7904995b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787823554.434036:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651858560 00000100:00100000:1.0:1787823554.434042:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651858560 00000100:00100000:1.0:1787823554.434064:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1787823554.434072:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:5835:x1874668651858560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787823554.434362:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:5835:x1874668651858560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 290us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823554.434370:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787823554.435066:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e79360bbc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651858560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787823554.435802:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823554.436068:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629802496 00000100:00100000:1.0:1787823554.436076:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629802496 00000100:00100000:1.0:1787823554.436122:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 241 00000100:00100000:1.0:1787823554.436318:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+12:5595:x1874668629802496:12345-192.168.202.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787823554.436336:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823554.436354:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e793a2f2a00/0x5d1142b8324817e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44685 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823554.436383:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e793a2f2a00/0x5d1142b8324817e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44685 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823554.436392:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e793a2f2a00/0x5d1142b8324817e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44685 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823554.436401:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a2f2a00, rc 0) 00000100:00100000:1.0:1787823554.436464:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+13:5595:x1874668629802496:12345-192.168.202.35@tcp:101:ll_cfg_requeue.0 Request processed in 160us (665us total) trans 0 rc 0/0 00000040:00080000:3.0:1787823554.437094:0:11191:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787823554.438794:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787823554.438830:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787823554.438847:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e79358d2a00/0x5d1142b8324817d5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324817dc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823554.438859:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e79358d2a00/0x5d1142b8324817d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324817dc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787823554.438880:0:5835:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787823554.438884:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e79034dc800 from 7 10000000:01000000:0.0:1787823554.438887:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787823554.438932:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e79013a2400/0x5d1142b8324817ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823554.438941:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e79013a2400/0x5d1142b8324817ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823554.438952:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e79013a2400/0x5d1142b8324817ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823554.438987:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e79360bbc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651858688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787823554.441432:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823554.441484:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7904995b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787823554.441511:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651858688 00000100:00100000:0.0:1787823554.441520:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651858688 00000100:00100000:1.0:1787823554.445384:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 241 00000100:00100000:2.0:1787823554.445751:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823554.450135:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629802624 00000100:00100000:0.0:1787823554.450151:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629802624 00000100:00100000:0.0:1787823554.450276:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787823554.450288:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:5835:x1874668651858688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787823554.450307:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823554.450587:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e79013a2000/0x5d1142b8324817f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b8324817ea expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823554.450621:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e79013a2000/0x5d1142b8324817f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b8324817ea expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823554.450632:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e79013a2000/0x5d1142b8324817f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b8324817ea expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823554.450642:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79013a2000, rc 0) 00000100:00100000:0.0:1787823554.450744:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:5835:x1874668651858688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 459us (9323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823554.450752:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787823554.450814:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 243 00000100:00100000:0.0:1787823554.450821:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903726450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+13:5595:x1874668629802624:12345-192.168.202.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787823554.451647:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e79360bbc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651858688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787823554.451670:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e79013a2400/0x5d1142b8324817ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324817f1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823554.451682:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e79013a2400/0x5d1142b8324817ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b8324817f1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823554.451755:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a49cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651858816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787823554.451819:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823554.451843:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e792ec58900 going to sleep for 11 seconds 00000100:00100000:1.0:1787823554.452098:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651858816 00000100:00100000:1.0:1787823554.452104:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651858816 00000100:00100000:1.0:1787823554.452144:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787823554.452152:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:5835:x1874668651858816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787823554.454864:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903726450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+13:5595:x1874668629802624:12345-192.168.202.35@tcp:501:ll_cfg_requeue.0 Request processed in 4025us (9097us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823554.455273:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 243 00000100:00100000:2.0:1787823554.459079:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:5835:x1874668651858816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 6918us (7250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823554.459097:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787823554.459203:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a49cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651858816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787823554.459264:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a49cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651858944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787823554.459313:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823554.459353:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e792ec58900 going to sleep for 11 seconds 00000100:00100000:1.0:1787823554.459558:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651858944 00000100:00100000:1.0:1787823554.459928:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651858944 00000100:00100000:1.0:1787823554.459991:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787823554.460001:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:5835:x1874668651858944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787823554.460386:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:5835:x1874668651858944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 386us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823554.460394:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787823554.461886:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a49cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651858944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787823554.463399:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823554.463638:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629802752 00000100:00100000:1.0:1787823554.463646:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629802752 00000100:00100000:1.0:1787823554.463714:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 246 00000100:00100000:1.0:1787823554.463724:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903727450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+13:5595:x1874668629802752:12345-192.168.202.35@tcp:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787823554.463954:0:11193:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000100:00100000:1.0:1787823554.463970:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903727450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+13:5595:x1874668629802752:12345-192.168.202.35@tcp:503:ll_cfg_requeue.0 Request processed in 247us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823554.463979:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 246 00000020:01000000:3.0:1787823554.464136:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787823554.464168:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787823554.464179:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e79013a2400/0x5d1142b8324817ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324817f1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823554.464192:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e79013a2400/0x5d1142b8324817ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324817f1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823554.794322:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823555.049974:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e79360bbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874668651859200:0@lo:400:kworker.0 00000100:00100000:0.0:1787823555.050039:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823555.050095:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787823555.050101:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e79360bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651859328:0@lo:400:kworker.0 00000100:00100000:0.0:1787823555.050128:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823555.050180:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651859328 00000100:00100000:1.0:1787823555.050181:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e79360b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874668651859072:0@lo:400:kworker.0 00000100:00100000:0.0:1787823555.050188:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651859328 00000100:00100000:1.0:1787823555.050211:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823555.050230:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792eb06940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651859584:0@lo:400:kworker.0 00000100:00100000:1.0:1787823555.050248:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823555.050252:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787823555.050262:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792eb04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651859328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823555.050265:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787823555.050270:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e79360b83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874668651859456:0@lo:400:kworker.0 00000100:00100000:1.0:1787823555.050289:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823555.050314:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651859200 00000100:00100000:1.0:1787823555.050318:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651859200 00000100:00100000:0.0:1787823555.050320:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792eb04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651859328:12345-0@lo:400:kworker.0 Request processed in 60us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823555.050328:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787823555.050346:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651859584 00000100:00100000:0.0:1787823555.050348:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651859584 00000100:00100000:1.0:1787823555.050352:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651859072 00000100:00100000:1.0:1787823555.050354:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651859072 00000100:00100000:1.0:1787823555.050362:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651859456 00000100:00100000:0.0:1787823555.050364:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787823555.050365:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651859456 00000100:00100000:0.0:1787823555.050369:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7935169e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651859584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823555.050377:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787823555.050382:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792eb07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874668651859200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823555.050398:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7935169e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651859584:12345-0@lo:400:kworker.0 Request processed in 29us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823555.050404:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787823555.050408:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792eb07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874668651859200:12345-0@lo:400:kworker.0 Request processed in 26us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823555.050413:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787823555.050425:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787823555.050429:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7935168f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874668651859072:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1787823555.050451:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e79360bb480 x1874668651859328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823555.050467:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e79360bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651859328:0@lo:400:kworker.0 00000100:00100000:1.0:1787823555.050468:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7935168f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874668651859072:12345-0@lo:400:kworker.0 Request processed in 39us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823555.050474:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787823555.050478:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e79360bbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874668651859200:0@lo:400:kworker.0 00000100:00100000:1.0:1787823555.050485:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787823555.050489:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793516b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874668651859456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823555.050526:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793516b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874668651859456:12345-0@lo:400:kworker.0 Request processed in 36us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823555.050531:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:1.0:1787823555.050548:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787823555.050552:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787823555.050555:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787823555.050583:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e79360b83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874668651859456:0@lo:400:kworker.0 00000100:00100000:1.0:1787823555.050592:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e79360b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874668651859072:0@lo:400:kworker.0 00010000:00080000:1.0:1787823555.050601:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e792eb06940 x1874668651859584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787823555.050609:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792eb06940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651859584:0@lo:400:kworker.0 00000100:00100000:2.0:1787823555.563541:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787823555.563566:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a49cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651859712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787823555.563636:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823555.563705:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651859712 00000100:00100000:2.0:1787823555.563713:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651859712 00000100:00100000:2.0:1787823555.563783:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787823555.563793:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a49e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651859712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787823555.563828:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787823555.563871:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a49e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651859712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823555.563878:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1787823555.563919:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e793a49cb40 x1874668651859712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823571 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823555.563939:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a49cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651859712:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787823555.820239:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823556.844874:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787823557.826882:0:11369:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg235-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787823557.866226:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823558.124655:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787823558.124682:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792eb07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651859840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787823558.124783:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823558.124917:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651859840 00000100:00100000:0.0:1787823558.124924:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651859840 00000100:00100000:0.0:1787823558.124987:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787823558.124997:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793516b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651859840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787823558.125031:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787823558.125079:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793516b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651859840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823558.125086:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1787823558.125161:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e792eb07480 x1874668651859840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823574 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823558.125181:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792eb07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651859840:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787823558.125842:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787823558.894932:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823559.369033:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823559.369088:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823559.369134:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823559.369167:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629803136 00000100:00100000:0.0:1787823559.369177:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629803136 00000100:00100000:0.0:1787823559.369238:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629803008 00000100:00100000:0.0:1787823559.369241:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629803008 00000100:00100000:0.0:1787823559.369277:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 95 00000100:00100000:0.0:1787823559.369287:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792eb07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2354:x1874668629803136:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787823559.369358:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792eb07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2354:x1874668629803136:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 72us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823559.369365:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 95 00000100:00100000:0.0:1787823559.369396:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 96 00000100:00100000:0.0:1787823559.369403:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792eb06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+6:2354:x1874668629803008:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787823559.369430:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792eb06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+6:2354:x1874668629803008:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 27us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823559.369437:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 96 00000100:00080000:0.0:1787823559.369457:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787823559.370098:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629802880 00000100:00100000:3.0:1787823559.370104:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629802880 00000100:00100000:3.0:1787823559.370160:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 247 00000100:00100000:3.0:1787823559.370168:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903727850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+13:2354:x1874668629802880:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787823559.370206:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903727850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+13:2354:x1874668629802880:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 39us (1185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823559.370212:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 247 00010000:00010000:2.0:1787823559.917240:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823560.171180:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e79360b83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874668651860096:0@lo:400:kworker.0 00000100:00100000:0.0:1787823560.171248:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823560.171298:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922b883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651860608:0@lo:400:kworker.0 00000100:00100000:0.0:1787823560.171324:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823560.171356:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787823560.171363:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e79360b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651859968:0@lo:400:kworker.0 00000100:00100000:0.0:1787823560.171391:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823560.171413:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922b8a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874668651860480:0@lo:400:kworker.0 00000100:00100000:0.0:1787823560.171435:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823560.171461:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e79360bbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874668651860224:0@lo:400:kworker.0 00000100:00100000:0.0:1787823560.171485:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823560.171502:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787823560.171507:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e79360bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651860352:0@lo:400:kworker.0 00000100:00100000:0.0:1787823560.171528:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823560.171559:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651860096 00000100:00100000:0.0:1787823560.171567:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651860096 00000100:00100000:0.0:1787823560.171611:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651860480 00000100:00100000:0.0:1787823560.171614:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651860480 00000100:00100000:0.0:1787823560.171634:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651860224 00000100:00100000:0.0:1787823560.171636:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651860224 00000100:00100000:0.0:1787823560.171666:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787823560.171673:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922b8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874668651860096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823560.171720:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922b8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874668651860096:12345-0@lo:400:kworker.0 Request processed in 47us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823560.171727:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787823560.171743:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787823560.171749:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922b8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874668651860480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823560.171805:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922b8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874668651860480:12345-0@lo:400:kworker.0 Request processed in 56us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823560.171811:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787823560.171823:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787823560.171829:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922b8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874668651860224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823560.172242:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922b8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874668651860224:12345-0@lo:400:kworker.0 Request processed in 412us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823560.172249:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787823560.172269:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651860608 00000100:00100000:0.0:1787823560.172272:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651860608 00000100:00100000:0.0:1787823560.172307:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651860352 00000100:00100000:0.0:1787823560.172309:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651860352 00000100:00100000:0.0:1787823560.172322:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787823560.172327:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922b8bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651860608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823560.172356:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922b8bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651860608:12345-0@lo:400:kworker.0 Request processed in 29us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823560.172361:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787823560.172369:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787823560.172374:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922b88b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651860352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823560.172422:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922b88b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651860352:12345-0@lo:400:kworker.0 Request processed in 47us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823560.172428:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787823560.172446:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651859968 00000100:00100000:0.0:1787823560.172450:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651859968 00000100:00100000:0.0:1787823560.172477:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787823560.172484:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903724450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3306:x1874668651859968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823560.172512:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903724450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3306:x1874668651859968:12345-0@lo:400:kworker.0 Request processed in 29us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823560.172518:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00080000:0.0:1787823560.172554:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787823560.172558:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787823560.172560:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787823560.172589:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e79360bb480 x1874668651860352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823560.172606:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e79360bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651860352:0@lo:400:kworker.0 00000100:00100000:0.0:1787823560.172619:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e79360bbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874668651860224:0@lo:400:kworker.0 00000100:00100000:0.0:1787823560.172647:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e79360b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651859968:0@lo:400:kworker.0 00000100:00100000:0.0:1787823560.172656:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922b8a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874668651860480:0@lo:400:kworker.0 00000100:00100000:0.0:1787823560.172665:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e79360b83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874668651860096:0@lo:400:kworker.0 00010000:00080000:0.0:1787823560.172675:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7922b883c0 x1874668651860608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823560.172685:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922b883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651860608:0@lo:400:kworker.0 00000100:00100000:0.0:1787823560.682436:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a49cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651860736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787823560.682515:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823560.682654:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651860736 00000100:00100000:2.0:1787823560.682663:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651860736 00000100:00100000:2.0:1787823560.682723:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787823560.682748:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922b883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651860736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787823560.682805:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787823560.682852:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922b883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651860736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823560.682860:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1787823560.683021:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e793a49cb40 x1874668651860736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823576 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787823560.683041:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a49cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651860736:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787823560.937977:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823561.965999:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787823562.202331:0:11468:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 05:39:20 (1787823560) === 00000100:00100000:1.0:1787823562.530344:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823562.530487:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823562.530534:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629803392 00000100:00100000:1.0:1787823562.530545:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629803392 00000100:00100000:1.0:1787823562.530597:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 0 00000100:00100000:1.0:1787823562.530606:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7920d61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:353832f0-fe7b-4d99-975c-a8041babed42+6:9679:x1874668629803392:12345-192.168.202.35@tcp:700:mkdir.0 00000100:00100000:1.0:1787823562.530693:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7920d61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:353832f0-fe7b-4d99-975c-a8041babed42+6:9679:x1874668629803392:12345-192.168.202.35@tcp:700:mkdir.0 Request processed in 88us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823562.530701:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 0 00000100:00080000:1.0:1787823562.530720:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787823562.531676:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629803264 00000100:00100000:3.0:1787823562.531684:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629803264 00000100:00100000:3.0:1787823562.531743:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 14 00000100:00100000:3.0:1787823562.531752:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793516a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+6:2355:x1874668629803264:12345-192.168.202.35@tcp:41:mkdir.0 00000004:00000024:3.0:1787823562.531802:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787823562.531882:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793516a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+6:2355:x1874668629803264:12345-192.168.202.35@tcp:41:mkdir.0 Request processed in 130us (1552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823562.531889:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 14 00000100:00100000:1.0:1787823562.542228:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823562.542309:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629803648 00000100:00100000:2.0:1787823562.542322:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629803648 00000100:00100000:2.0:1787823562.542399:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 15 00000100:00100000:2.0:1787823562.542410:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790ae82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+6:9679:x1874668629803648:12345-192.168.202.35@tcp:36:mkdir.0 00010000:00010000:2.0:1787823562.542487:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787823562.542563:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b8324816d9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44607 expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.542584:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e7917859100) 00010000:00010000:2.0:1787823562.542608:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787823562.543009:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b8324817f8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.543024:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b8324817f8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.543033:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b8324817f8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.543044:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b8324817ff lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.543052:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b8324817ff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.543067:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b8324817ff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787823562.544353:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787823562.544368:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b8324817f8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.544377:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b8324817f8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.544385:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b8324817f8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.544391:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d2200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823562.544395:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b8324817f8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.544404:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b8324817f8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.544418:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e79228da500) 00010000:00010000:2.0:1787823562.544421:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823562.544426:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b8324817f8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.544432:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b8324817f8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787823562.544450:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b5d39ae5 reply state 0000000027e0d832 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b8324817ff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823562.544469:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787823562.544584:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790ae82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+7:9679:x1874668629803648:12345-192.168.202.35@tcp:36:mkdir.0 Request processed in 2172us (2365us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787823562.544595:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 15 00010000:00010000:1.0:1787823562.546130:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b8324817ff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.546145:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b8324817ff lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.546152:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b8324817ff lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.546157:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823562.546162:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b8324817ff lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.546169:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b8324817ff lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.546184:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e79228dad00) 00010000:00010000:1.0:1787823562.546187:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823562.546205:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b8324817ff lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.546211:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b8324817ff lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823562.572380:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823562.572507:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629803776 00000100:00100000:0.0:1787823562.572518:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629803776 00000100:00100000:0.0:1787823562.572590:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 16 00000100:00100000:0.0:1787823562.572603:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790ae80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+6:9680:x1874668629803776:12345-192.168.202.35@tcp:101:chmod.0 00010000:00010000:0.0:1787823562.572627:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823562.572651:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79013a2800/0x5d1142b832481806 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f4468c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.572722:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79013a3000/0x5d1142b83248180d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.572737:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79013a3000/0x5d1142b83248180d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.572748:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79013a3000/0x5d1142b83248180d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787823562.572865:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787823562.572869:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787823562.572918:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e79013a3000/0x5d1142b83248180d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.572948:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79013a2800/0x5d1142b832481806 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4468c expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.572968:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79013a3000/0x5d1142b83248180d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4468c expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.572995:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e791767bf00) 00010000:00010000:0.0:1787823562.572999:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787823562.573004:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79013a3000, rc 0) 00000100:00100000:0.0:1787823562.573077:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790ae80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+7:9680:x1874668629803776:12345-192.168.202.35@tcp:101:chmod.0 Request processed in 477us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823562.573084:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 16 00000100:00100000:3.0:1787823562.582628:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823562.582811:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629804032 00000100:00100000:2.0:1787823562.582822:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629804032 00000100:00100000:2.0:1787823562.582877:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 17 00000100:00100000:2.0:1787823562.582889:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+7:9680:x1874668629804032:12345-192.168.202.35@tcp:36:chmod.0 00010000:00010000:2.0:1787823562.582955:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787823562.582986:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79013a3000/0x5d1142b83248180d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4468c expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.583005:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e791767bf00) 00010000:00010000:2.0:1787823562.583016:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787823562.583042:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481814 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.583054:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481814 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.583063:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481814 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787823562.583423:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000087755ad0 reply state 00000000ba7d805f transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481814 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823562.583434:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787823562.583463:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787823562.583576:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+8:9680:x1874668629804032:12345-192.168.202.35@tcp:36:chmod.0 Request processed in 688us (960us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787823562.583586:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 17 00010000:00010000:0.0:1787823562.590566:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481814 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.590586:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481814 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.590594:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481814 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.590600:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823562.590604:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481814 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.590611:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481814 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.590628:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e79228da500) 00010000:00010000:0.0:1787823562.590631:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787823562.590636:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481814 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.590642:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481814 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823562.617832:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823562.617996:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629804160 00000100:00100000:0.0:1787823562.618007:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629804160 00000100:00100000:0.0:1787823562.618071:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 18 00000100:00100000:0.0:1787823562.618082:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+7:9681:x1874668629804160:12345-192.168.202.35@tcp:101:chown.0 00010000:00010000:0.0:1787823562.618120:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823562.618146:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79013a2800/0x5d1142b83248181b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44693 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.618220:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79013a3c00/0x5d1142b832481822 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.618235:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79013a3c00/0x5d1142b832481822 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.618247:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79013a3c00/0x5d1142b832481822 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787823562.618303:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787823562.618307:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787823562.618349:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e79013a3c00/0x5d1142b832481822 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.618374:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79013a2800/0x5d1142b83248181b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44693 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.618392:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79013a3c00/0x5d1142b832481822 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44693 expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.618399:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e791767b900) 00010000:00010000:0.0:1787823562.618409:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787823562.618413:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79013a3c00, rc 0) 00000100:00100000:0.0:1787823562.618489:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+8:9681:x1874668629804160:12345-192.168.202.35@tcp:101:chown.0 Request processed in 409us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823562.618496:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 18 00000100:00100000:2.0:1787823562.625307:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823562.625415:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629804288 00000100:00100000:0.0:1787823562.625427:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629804288 00000100:00100000:0.0:1787823562.625501:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 19 00000100:00100000:0.0:1787823562.625513:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a49c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+8:9681:x1874668629804288:12345-192.168.202.35@tcp:101:chown.0 00010000:00010000:0.0:1787823562.625535:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823562.625556:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79013a2800/0x5d1142b832481829 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f4469a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.625627:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79013a3000/0x5d1142b832481830 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.625643:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79013a3000/0x5d1142b832481830 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.625655:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79013a3000/0x5d1142b832481830 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.625694:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481837 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.625703:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481837 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.625710:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481837 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.626059:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e400/0x5d1142b83248183e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.626069:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e400/0x5d1142b83248183e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.626077:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e400/0x5d1142b83248183e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787823562.626139:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787823562.626144:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787823562.626168:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e400/0x5d1142b83248183e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.626182:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79013a3000/0x5d1142b832481830 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.626188:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79013a3000/0x5d1142b832481830 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.626195:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79013a3000/0x5d1142b832481830 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.626201:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79013a3000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823562.626205:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79013a3000/0x5d1142b832481830 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.626214:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79013a3000/0x5d1142b832481830 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.626228:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e791767b900) 00010000:00010000:0.0:1787823562.626239:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823562.626245:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79013a3000/0x5d1142b832481830 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.626252:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79013a3000/0x5d1142b832481830 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.626268:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481837 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.626275:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481837 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.626280:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481837 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.626286:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40fe00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823562.626289:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481837 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.626295:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481837 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.626303:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e791767b700) 00010000:00010000:0.0:1787823562.626305:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823562.626309:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481837 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.626315:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481837 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.626352:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79013a2800/0x5d1142b832481829 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4469a expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.626382:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e400/0x5d1142b83248183e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4469a expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.626389:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e791767b000) 00010000:00010000:0.0:1787823562.626392:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787823562.626394:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40e400, rc 0) 00000100:00100000:0.0:1787823562.626668:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a49c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+9:9681:x1874668629804288:12345-192.168.202.35@tcp:101:chown.0 Request processed in 1155us (1374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823562.626676:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 19 00000100:00100000:2.0:1787823562.631668:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823562.631891:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629804544 00000100:00100000:0.0:1787823562.631903:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629804544 00000100:00100000:1.0:1787823562.632146:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 20 00000100:00100000:1.0:1787823562.632160:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a49f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+9:9681:x1874668629804544:12345-192.168.202.35@tcp:36:chown.0 00010000:00010000:1.0:1787823562.632223:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823562.632264:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e400/0x5d1142b83248183e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4469a expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.632287:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e791767b000) 00010000:00010000:1.0:1787823562.632297:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787823562.632324:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3400/0x5d1142b832481845 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.632339:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3400/0x5d1142b832481845 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.632351:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3400/0x5d1142b832481845 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787823562.662727:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1787823562.663015:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000045d6fe81 reply state 00000000cc91dd5c transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3400/0x5d1142b832481845 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823562.663030:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787823562.663354:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:3.0:1787823562.663509:0:5838:0:(ldlm_lib.c:3492:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1787823562.663560:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a49f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+7:9681:x1874668629804544:12345-192.168.202.35@tcp:36:chown.0 Request processed in 31399us (31900us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787823562.663571:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 20 00010000:00010000:1.0:1787823562.664040:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3400/0x5d1142b832481845 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.664125:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3400/0x5d1142b832481845 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.664134:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3400/0x5d1142b832481845 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.664153:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f3400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823562.664158:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3400/0x5d1142b832481845 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.664166:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3400/0x5d1142b832481845 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.664187:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e7917859c00) 00010000:00010000:1.0:1787823562.664190:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787823562.664195:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3400/0x5d1142b832481845 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.664201:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3400/0x5d1142b832481845 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823562.677671:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823562.677892:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629804672 00000100:00100000:3.0:1787823562.677901:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629804672 00000100:00100000:3.0:1787823562.677968:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 21 00000100:00100000:3.0:1787823562.677979:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a49cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+6:9682:x1874668629804672:12345-192.168.202.35@tcp:101:touch.500 00010000:00010000:3.0:1787823562.678004:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823562.678029:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b83248184c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f446a1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787823562.679329:0:5840:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1226us 00010000:00010000:2.0:1787823562.716917:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481853 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.716940:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481853 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.716953:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481853 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.716970:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b83248185a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.716978:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b83248185a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.716986:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b83248185a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.717483:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2e00/0x5d1142b832481861 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.717493:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2e00/0x5d1142b832481861 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.717500:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2e00/0x5d1142b832481861 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787823562.717588:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787823562.717593:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787823562.717694:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2e00/0x5d1142b832481861 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.717707:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481853 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.717714:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481853 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.717720:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481853 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.717726:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d2200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823562.717731:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481853 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.717738:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481853 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.717750:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e791767b900) 00010000:00010000:2.0:1787823562.717753:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823562.717779:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481853 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.717786:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481853 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.717797:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b83248185a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.717813:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b83248185a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.717818:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b83248185a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.717822:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823562.717825:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b83248185a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.717832:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b83248185a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.717840:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e79228daf00) 00010000:00010000:2.0:1787823562.717842:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823562.717846:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b83248185a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.717851:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b83248185a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.717891:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b83248184c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446a1 expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.717906:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2e00/0x5d1142b832481861 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446a1 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.717913:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e79228da800) 00010000:00010000:2.0:1787823562.717915:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787823562.717924:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d2e00, rc 0) 00000100:00100000:2.0:1787823562.718003:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a49cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+7:9682:x1874668629804672:12345-192.168.202.35@tcp:101:touch.500 Request processed in 40025us (40342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823562.718012:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 21 00000100:00100000:2.0:1787823562.728057:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823562.728459:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629804928 00000100:00100000:0.0:1787823562.728470:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629804928 00000100:00100000:0.0:1787823562.728541:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 22 00000100:00100000:0.0:1787823562.728551:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79261943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+7:9682:x1874668629804928:12345-192.168.202.35@tcp:101:touch.500 00010000:00010000:0.0:1787823562.728571:0:7893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823562.728591:0:7893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fc00/0x5d1142b832481868 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f446a8 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.728986:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b83248186f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.729002:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b83248186f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.729013:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b83248186f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.729068:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e800/0x5d1142b832481876 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.729076:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e800/0x5d1142b832481876 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.729083:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e800/0x5d1142b832481876 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787823562.730118:0:7893:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1787823562.730389:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e200/0x5d1142b83248187d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.730402:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e200/0x5d1142b83248187d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.730411:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e200/0x5d1142b83248187d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.730441:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b83248186f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.730448:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b83248186f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.730455:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b83248186f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.730460:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40f800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823562.730465:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b83248186f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.730481:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b83248186f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.730492:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e79228da800) 00010000:00010000:0.0:1787823562.730495:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823562.730500:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b83248186f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.730506:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b83248186f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787823562.730518:0:7893:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e80b58ba reply state 00000000412a1cc2 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e800/0x5d1142b832481876 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823562.730527:0:7893:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787823562.730557:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fc00/0x5d1142b832481868 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446a8 expref: 10 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.730569:0:7893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e200/0x5d1142b83248187d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446a8 expref: 9 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.730576:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e791767bd00) 00010000:00010000:0.0:1787823562.730578:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787823562.730580:0:7893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40e200, rc 0) 00000100:00100000:0.0:1787823562.730651:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79261943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+10:9682:x1874668629804928:12345-192.168.202.35@tcp:101:touch.500 Request processed in 2101us (2612us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787823562.730659:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 22 00010000:00010000:2.0:1787823562.734453:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e800/0x5d1142b832481876 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.734470:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e800/0x5d1142b832481876 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.734477:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e800/0x5d1142b832481876 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.734483:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40e800 already unused, calling callback (ffffffffc20994f0) 00000100:00100000:3.0:1787823562.734487:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00010000:00010000:2.0:1787823562.734488:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e800/0x5d1142b832481876 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.734495:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e800/0x5d1142b832481876 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.734511:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc51bb70 (ffff8e791767b700) 00010000:00010000:2.0:1787823562.734514:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787823562.734515:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629805184 00010000:00010000:2.0:1787823562.734519:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e800/0x5d1142b832481876 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823562.734522:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629805184 00010000:00010000:2.0:1787823562.734524:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e800/0x5d1142b832481876 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823562.734568:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 23 00000100:00100000:3.0:1787823562.734583:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+9:9682:x1874668629805184:12345-192.168.202.35@tcp:36:touch.500 00010000:00010000:3.0:1787823562.734638:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787823562.734657:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e200/0x5d1142b83248187d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446a8 expref: 9 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.734666:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e791767bd00) 00010000:00010000:3.0:1787823562.734672:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787823562.734723:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b83248188b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.734734:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b83248188b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.734743:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b83248188b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787823562.734869:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ee5f1b79 reply state 0000000007b1229c transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b83248188b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823562.734878:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787823562.734960:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+10:9682:x1874668629805184:12345-192.168.202.35@tcp:36:touch.500 Request processed in 383us (475us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787823562.742912:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 23 00000100:00100000:2.0:1787823562.743704:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823562.743814:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629805312 00000100:00100000:3.0:1787823562.743824:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629805312 00000100:00100000:3.0:1787823562.743871:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 24 00000100:00100000:3.0:1787823562.743881:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926194b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+10:9682:x1874668629805312:12345-192.168.202.35@tcp:101:touch.500 00010000:00010000:3.0:1787823562.743907:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823562.743927:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481892 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f446af expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.743973:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b83248188b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.743982:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b83248188b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.743990:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b83248188b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.744597:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481892 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446af expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.744614:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481892 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446af expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.744657:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e79087c9000) 00010000:00010000:3.0:1787823562.744660:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787823562.744663:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7920eebc00, rc 0) 00000100:00100000:3.0:1787823562.744792:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926194b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+11:9682:x1874668629805312:12345-192.168.202.35@tcp:101:touch.500 Request processed in 878us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823562.744800:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 24 00000100:00100000:2.0:1787823562.747537:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823562.747633:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629805440 00000100:00100000:0.0:1787823562.747646:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629805440 00000100:00100000:0.0:1787823562.747726:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 16 00000100:00100000:0.0:1787823562.747735:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79261961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1874668629805440:12345-192.168.202.35@tcp:8:touch.500 00010000:00080000:0.0:1787823562.747824:0:6687:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from 353832f0-fe7b-4d99-975c-a8041babed42@192.168.202.35@tcp t0 exp 0000000000000000 cur 303 last 0 00000020:00000080:0.0:1787823562.747857:0:6687:0:(genops.c:1385:class_connect()) connect: client 353832f0-fe7b-4d99-975c-a8041babed42, cookie 0x5d1142b832481899 00002000:00100000:0.0:1787823562.747868:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 353832f0-fe7b-4d99-975c-a8041babed42/ffff8e793a4bb800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787823562.747892:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787823562.748165:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787823562.748197:0:6687:0:(import.c:65:import_set_state_nolock()) ffff8e793a4be800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787823562.748276:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79261961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+6:2351:x1874668629805440:12345-192.168.202.35@tcp:8:touch.500 Request processed in 539us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823562.748283:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 16 00000100:00100000:0.0:1787823562.751005:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823562.751109:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629805568 00000100:00100000:2.0:1787823562.751120:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629805568 00000100:00100000:2.0:1787823562.751236:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 17 00000100:00100000:2.0:1787823562.751247:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922b88780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:353832f0-fe7b-4d99-975c-a8041babed42+6:0:x1874668629805568:12345-192.168.202.35@tcp:2:touch.500 00010000:00010000:1.0:1787823562.751282:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eeaa00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823562.751290:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b83248188b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.751302:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b83248188b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.751333:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e79087c9000) 00010000:00010000:1.0:1787823562.751335:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823562.751340:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b83248188b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.751346:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b83248188b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787823562.751615:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:2.0:1787823562.822438:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 353832f0-fe7b-4d99-975c-a8041babed42 00000001:00080000:2.0:1787823562.822459:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:1.0:1787823562.822827:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922b88780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:353832f0-fe7b-4d99-975c-a8041babed42+5:0:x1874668629805568:12345-192.168.202.35@tcp:2:touch.500 Request processed in 71574us (71827us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787823562.822839:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 17 00000100:00100000:0.0:1787823562.828485:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823562.828749:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629805824 00000100:00100000:2.0:1787823562.828797:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629805824 00000100:00100000:2.0:1787823562.828867:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 2 00000100:00100000:2.0:1787823562.828876:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922b8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+10:9682:x1874668629805824:12345-192.168.202.35@tcp:35:touch.500 00000100:00100000:2.0:1787823562.829460:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922b8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+11:9682:x1874668629805824:12345-192.168.202.35@tcp:35:touch.500 Request processed in 582us (984us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787823562.829471:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 2 00000100:00100000:2.0:1787823562.846102:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823562.846177:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629805952 00000100:00100000:1.0:1787823562.846188:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629805952 00000100:00100000:1.0:1787823562.846255:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 25 00000100:00100000:1.0:1787823562.846265:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939dc0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+11:9683:x1874668629805952:12345-192.168.202.35@tcp:101:rm.0 00010000:00010000:1.0:1787823562.846290:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823562.846311:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3400/0x5d1142b8324818a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f446b6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.846381:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2000/0x5d1142b8324818a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.846396:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2000/0x5d1142b8324818a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.846407:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2000/0x5d1142b8324818a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787823562.846468:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787823562.846483:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787823562.846525:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2000/0x5d1142b8324818a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.846553:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3400/0x5d1142b8324818a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446b6 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.846571:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2000/0x5d1142b8324818a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446b6 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.846580:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e79228da800) 00010000:00010000:1.0:1787823562.846583:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787823562.846586:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a2f2000, rc 0) 00000100:00100000:1.0:1787823562.846644:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939dc0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+12:9683:x1874668629805952:12345-192.168.202.35@tcp:101:rm.0 Request processed in 381us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823562.846651:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 25 00000100:00100000:0.0:1787823562.860116:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823562.860164:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629806208 00000100:00100000:2.0:1787823562.860174:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629806208 00000100:00100000:2.0:1787823562.860238:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 26 00000100:00100000:2.0:1787823562.860249:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922b8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+12:9683:x1874668629806208:12345-192.168.202.35@tcp:101:rm.0 00010000:00010000:2.0:1787823562.860270:0:7893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823562.860291:0:7893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2000/0x5d1142b8324818ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f446bd expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787823562.860436:0:7893:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787823562.860650:0:7893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2000/0x5d1142b8324818ae lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446bd expref: 14 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.860667:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e791767b900) 00010000:00010000:2.0:1787823562.860677:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787823562.860683:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2000/0x5d1142b8324818ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446bd expref: 14 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.860698:0:7893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d2000, rc 0) 00000100:00100000:2.0:1787823562.861032:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922b8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+13:9683:x1874668629806208:12345-192.168.202.35@tcp:101:rm.0 Request processed in 782us (930us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1787823562.861040:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 26 00000100:00100000:0.0:1787823562.872619:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823562.872711:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629806336 00000100:00100000:3.0:1787823562.872721:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629806336 00000100:00100000:0.0:1787823562.879419:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 3 00000100:00100000:0.0:1787823562.879439:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79360b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+13:9683:x1874668629806336:12345-192.168.202.35@tcp:37:rm.0 00000100:00100000:2.0:1787823562.887290:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79360b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+13:9683:x1874668629806336:12345-192.168.202.35@tcp:37:rm.0 Request processed in 7836us (14664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823562.887306:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 3 00000100:00100000:3.0:1787823562.890886:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823562.891215:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629806592 00000100:00100000:2.0:1787823562.891226:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629806592 00000100:00100000:2.0:1787823562.891326:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 4 00000100:00100000:2.0:1787823562.891337:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7925a93050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+13:9683:x1874668629806592:12345-192.168.202.35@tcp:35:rm.0 00000100:00100000:2.0:1787823562.891596:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7925a93050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+14:9683:x1874668629806592:12345-192.168.202.35@tcp:35:rm.0 Request processed in 260us (720us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787823562.891604:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 4 00000100:00100000:0.0:1787823562.905265:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823562.905413:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629806848 00000100:00100000:3.0:1787823562.905429:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629806848 00000100:00100000:3.0:1787823562.905507:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 27 00000100:00100000:3.0:1787823562.905519:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79360b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+14:9683:x1874668629806848:12345-192.168.202.35@tcp:101:rm.0 00010000:00010000:3.0:1787823562.905545:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823562.905570:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b8324818bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f446c4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.905703:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b8324818c3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.905720:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b8324818c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.905732:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b8324818c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787823562.905743:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787823562.905932:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b8324818bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446c4 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.905968:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b8324818c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446c4 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.905975:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e79228da800) 00010000:00010000:3.0:1787823562.905978:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787823562.905982:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7920eea600, rc 0) 00000100:00100000:3.0:1787823562.906042:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79360b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+16:9683:x1874668629806848:12345-192.168.202.35@tcp:101:rm.0 Request processed in 526us (793us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787823562.906051:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 27 00000100:00100000:3.0:1787823562.914535:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823562.914801:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629806976 00000100:00100000:1.0:1787823562.914815:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629806976 00000100:00100000:1.0:1787823562.914874:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 28 00000100:00100000:1.0:1787823562.914884:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+16:9683:x1874668629806976:12345-192.168.202.35@tcp:41:rm.0 00000004:00000024:1.0:1787823562.914943:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1787823562.915015:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+16:9683:x1874668629806976:12345-192.168.202.35@tcp:41:rm.0 Request processed in 133us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823562.915024:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 28 00000100:00100000:0.0:1787823562.924975:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823562.926262:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629807104 00000100:00100000:3.0:1787823562.926278:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629807104 00000100:00100000:3.0:1787823562.926361:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 29 00000100:00100000:3.0:1787823562.926371:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79360bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+16:9683:x1874668629807104:12345-192.168.202.35@tcp:101:rm.0 00010000:00010000:3.0:1787823562.926397:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823562.926419:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b8324818d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f446cb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.926495:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b8324818d8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.926510:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b8324818d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.926522:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b8324818d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.926559:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b8324818df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.926567:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b8324818df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.926574:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b8324818df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.926704:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031c00/0x5d1142b8324818e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.926713:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031c00/0x5d1142b8324818e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.926719:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031c00/0x5d1142b8324818e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787823562.926750:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787823562.926754:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787823562.926821:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031c00/0x5d1142b8324818e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.926834:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031c00/0x5d1142b8324818e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.926841:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b8324818d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.926847:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b8324818d8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.926864:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b8324818d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.926870:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eeaa00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823562.926874:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b8324818d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.926882:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b8324818d8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.926894:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e79228da800) 00010000:00010000:3.0:1787823562.926897:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787823562.926901:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b8324818d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.926907:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b8324818d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.926922:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b8324818df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.926927:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b8324818df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.926932:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b8324818df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.926936:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eeac00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823562.926938:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b8324818df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.926953:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b8324818df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.926962:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc51bb70 (ffff8e79087c9600) 00010000:00010000:3.0:1787823562.926964:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787823562.926966:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b8324818df lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.926971:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b8324818df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.927002:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b8324818d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446cb expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.927014:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031c00/0x5d1142b8324818e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446cb expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.927020:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e79087c9000) 00010000:00010000:3.0:1787823562.927022:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787823562.927024:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7900031c00, rc 0) 00000100:00100000:3.0:1787823562.927127:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79360bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+17:9683:x1874668629807104:12345-192.168.202.35@tcp:101:rm.0 Request processed in 758us (2163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823562.927134:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 29 00000100:00100000:0.0:1787823562.930381:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823562.930470:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629807360 00000100:00100000:1.0:1787823562.930481:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629807360 00000100:00100000:1.0:1787823562.930541:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 30 00000100:00100000:1.0:1787823562.930552:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79360bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+17:9683:x1874668629807360:12345-192.168.202.35@tcp:36:rm.0 00010000:00010000:1.0:1787823562.930631:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787823562.930662:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031c00/0x5d1142b8324818e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446cb expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.930684:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481892 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446af expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.930694:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e79087c9000) 00010000:00010000:1.0:1787823562.930711:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2000/0x5d1142b8324818a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446b6 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.930719:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e79228da800) 00010000:00010000:1.0:1787823562.930723:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787823562.930791:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3400/0x5d1142b8324818ed lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.930803:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3400/0x5d1142b8324818ed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.930814:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3400/0x5d1142b8324818ed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.930828:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3000/0x5d1142b8324818f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.930835:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3000/0x5d1142b8324818f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.930841:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3000/0x5d1142b8324818f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.931013:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b8324818fb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.931021:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b8324818fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.931028:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b8324818fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787823562.931865:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1787823562.931879:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 303786119322ns, next at 304786116024ns, rc = 0 00010000:00010000:1.0:1787823562.931940:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481902 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.931951:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481902 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.931959:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481902 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.931966:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481902 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.931973:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481902 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.931979:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481902 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.932012:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787823562.932030:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b8324818fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.932041:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b8324818fb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.932047:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b8324818fb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.932053:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f2e00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823562.932058:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b8324818fb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.932066:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b8324818fb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.932079:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e7917859a00) 00010000:00010000:1.0:1787823562.932082:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787823562.932097:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b8324818fb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.932103:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b8324818fb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.932121:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3400/0x5d1142b8324818ed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.932126:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3400/0x5d1142b8324818ed lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.932132:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3400/0x5d1142b8324818ed lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.932136:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f3400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823562.932147:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3400/0x5d1142b8324818ed lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.932153:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3400/0x5d1142b8324818ed lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.932162:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e79228da800) 00010000:00010000:1.0:1787823562.932165:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823562.932168:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3400/0x5d1142b8324818ed lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.932173:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3400/0x5d1142b8324818ed lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787823562.932182:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c129e3ca reply state 000000000d1fdf62 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3000/0x5d1142b8324818f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823562.932191:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787823562.932192:0:7629:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787823562.932199:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481902 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.932205:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f2200 already unused, calling callback (ffffffffc1649440) 00010000:00010000:3.0:1787823562.932214:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481902 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.932219:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481902 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.932239:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e7917859a00) 00010000:00010000:3.0:1787823562.932242:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787823562.932245:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481902 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.932249:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481902 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823562.932264:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823562.932266:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823562.932267:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823562.932344:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79360bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+16:9683:x1874668629807360:12345-192.168.202.35@tcp:36:rm.0 Request processed in 1789us (1969us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787823562.932354:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 30 00010000:00010000:2.0:1787823562.941234:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3000/0x5d1142b8324818f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.941254:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3000/0x5d1142b8324818f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.941262:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3000/0x5d1142b8324818f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.941269:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f3000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823562.941287:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3000/0x5d1142b8324818f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.941296:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3000/0x5d1142b8324818f4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.941312:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc51bb70 (ffff8e7917859600) 00010000:00010000:2.0:1787823562.941315:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823562.941320:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3000/0x5d1142b8324818f4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.941327:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3000/0x5d1142b8324818f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823562.943303:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823562.943710:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629807616 00000100:00100000:3.0:1787823562.943721:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629807616 00000100:00100000:3.0:1787823562.943816:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 5 00000100:00100000:3.0:1787823562.943828:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79360b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+15:9683:x1874668629807616:12345-192.168.202.35@tcp:35:rm.0 00000100:00100000:3.0:1787823562.944114:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79360b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+16:9683:x1874668629807616:12345-192.168.202.35@tcp:35:rm.0 Request processed in 287us (820us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787823562.944122:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 5 00000100:00100000:3.0:1787823562.966248:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823562.968317:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629807872 00000100:00100000:1.0:1787823562.968336:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629807872 00000100:00100000:1.0:1787823562.968421:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 31 00000100:00100000:1.0:1787823562.968433:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+16:9683:x1874668629807872:12345-192.168.202.35@tcp:36:rm.0 00010000:00010000:1.0:1787823562.968515:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787823562.968548:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b8324818c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446c4 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.968572:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2e00/0x5d1142b832481861 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446a1 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.968599:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e79228da800) 00010000:00010000:1.0:1787823562.968616:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79013a3c00/0x5d1142b832481822 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44693 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.968624:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e791767b900) 00010000:00010000:1.0:1787823562.968631:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787823562.968659:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3400/0x5d1142b832481909 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.968672:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3400/0x5d1142b832481909 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.968683:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3400/0x5d1142b832481909 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.968696:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b832481910 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.968704:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b832481910 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.968709:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b832481910 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.969080:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2000/0x5d1142b832481917 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.969097:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2000/0x5d1142b832481917 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.969115:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2000/0x5d1142b832481917 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787823562.973674:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787823562.973704:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2000/0x5d1142b832481917 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.973726:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2000/0x5d1142b832481917 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.973733:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2000/0x5d1142b832481917 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.973741:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f2000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823562.973746:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2000/0x5d1142b832481917 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.973754:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2000/0x5d1142b832481917 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.975246:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e7917859600) 00010000:00010000:0.0:1787823562.975251:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787823562.975258:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2000/0x5d1142b832481917 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.975266:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2000/0x5d1142b832481917 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.975306:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3400/0x5d1142b832481909 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.975313:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3400/0x5d1142b832481909 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.975320:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3400/0x5d1142b832481909 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.975325:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f3400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823562.975347:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3400/0x5d1142b832481909 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.975354:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3400/0x5d1142b832481909 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.975362:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e7917859c00) 00010000:00010000:0.0:1787823562.975365:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823562.975367:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3400/0x5d1142b832481909 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823562.975373:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3400/0x5d1142b832481909 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787823562.975387:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e1a0b8e7 reply state 000000005897af72 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b832481910 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823562.975398:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787823562.975535:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+15:9683:x1874668629807872:12345-192.168.202.35@tcp:36:rm.0 Request processed in 7099us (9307us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787823562.975545:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 31 00010000:00010000:1.0:1787823562.983999:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b832481910 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.984019:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b832481910 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.984028:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b832481910 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.984034:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f2e00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823562.984039:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b832481910 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.984046:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b832481910 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.984075:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e7917859000) 00010000:00010000:1.0:1787823562.984078:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823562.984093:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b832481910 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823562.984100:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b832481910 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823562.986561:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823563.242612:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787823563.242642:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7926244b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651860864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787823563.242787:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823563.243014:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651860864 00000100:00100000:2.0:1787823563.243023:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651860864 00000100:00100000:2.0:1787823563.243100:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787823563.243110:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790ae830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651860864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787823563.243151:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787823563.243202:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790ae830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651860864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823563.243208:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1787823563.243267:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7926244b40 x1874668651860864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823579 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823563.243291:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7926244b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651860864:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787823563.243425:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787823564.009889:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823564.486781:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823564.486828:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823564.486908:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629808128 00000100:00100000:3.0:1787823564.486917:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629808128 00000100:00100000:3.0:1787823564.486984:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629808384 00000100:00100000:3.0:1787823564.486988:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629808384 00000100:00100000:3.0:1787823564.487013:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 100 00000100:00100000:3.0:1787823564.487023:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926245e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+14:2354:x1874668629808128:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787823564.489550:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 101 00000100:00100000:2.0:1787823564.489570:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926244780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2354:x1874668629808384:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787823564.490647:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926245e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+14:2354:x1874668629808128:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 3617us (3891us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823564.490659:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 100 00000100:00080000:3.0:1787823564.490697:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787823564.491018:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823564.491302:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629808000 00000100:00100000:3.0:1787823564.491311:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629808000 00000100:00100000:3.0:1787823564.491354:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 249 00000100:00100000:3.0:1787823564.491362:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+13:2354:x1874668629808000:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787823564.491409:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+13:2354:x1874668629808000:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 48us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823564.491416:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 249 00000100:00100000:1.0:1787823564.494438:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823564.494776:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926244780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2354:x1874668629808384:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 5198us (7931us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823564.494788:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 101 00000100:00100000:0.0:1787823564.498813:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629808256 00000100:00100000:0.0:1787823564.498824:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629808256 00000100:00100000:0.0:1787823564.498890:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 57 00000100:00100000:0.0:1787823564.498902:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+5:2354:x1874668629808256:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787823564.498993:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+5:2354:x1874668629808256:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 94us (4565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823564.498999:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 57 00000100:00080000:1.0:1787823564.501466:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787823565.034002:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823565.290482:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7926245680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874668651861120:0@lo:400:kworker.0 00000100:00100000:0.0:1787823565.290552:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823565.290614:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651861632:0@lo:400:kworker.0 00000100:00100000:0.0:1787823565.290641:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823565.290673:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787823565.290680:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7926247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651860992:0@lo:400:kworker.0 00000100:00100000:0.0:1787823565.290710:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823565.290730:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ad52580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874668651861504:0@lo:400:kworker.0 00000100:00100000:0.0:1787823565.290751:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823565.291472:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7926244b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874668651861248:0@lo:400:kworker.0 00000100:00100000:2.0:1787823565.291511:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823565.291548:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787823565.291553:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ad52d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651861376:0@lo:400:kworker.0 00000100:00100000:2.0:1787823565.291575:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823565.291719:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651861120 00000100:00100000:1.0:1787823565.291727:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651861120 00000100:00100000:1.0:1787823565.291984:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651861504 00000100:00100000:1.0:1787823565.291988:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651861504 00000100:00100000:1.0:1787823565.292016:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651861248 00000100:00100000:1.0:1787823565.292019:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651861248 00000100:00100000:1.0:1787823565.292038:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787823565.292046:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4cb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874668651861120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823565.292115:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4cb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874668651861120:12345-0@lo:400:kworker.0 Request processed in 69us (1562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823565.292122:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787823565.292138:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787823565.292144:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874668651861504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823565.292170:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874668651861504:12345-0@lo:400:kworker.0 Request processed in 27us (1418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823565.292175:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787823565.292185:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787823565.292191:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939dc0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874668651861248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823565.293203:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ad52580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874668651861504:0@lo:400:kworker.0 00000100:00100000:0.0:1787823565.293220:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7926245680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874668651861120:0@lo:400:kworker.0 00000100:00100000:0.0:1787823565.293271:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651861632 00000100:00100000:0.0:1787823565.293276:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651861632 00000100:00100000:0.0:1787823565.293327:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651861376 00000100:00100000:0.0:1787823565.293331:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651861376 00000100:00100000:0.0:1787823565.293349:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787823565.293356:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4ca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651861632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823565.293415:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4ca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651861632:12345-0@lo:400:kworker.0 Request processed in 59us (2773us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823565.293422:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787823565.293437:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787823565.293444:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939dc1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651861376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823565.293493:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939dc1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651861376:12345-0@lo:400:kworker.0 Request processed in 50us (1916us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823565.293500:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787823565.293520:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651860992 00000100:00100000:0.0:1787823565.293524:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651860992 00000100:00100000:0.0:1787823565.293551:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1787823565.293558:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903726850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3306:x1874668651860992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823565.293589:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903726850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3306:x1874668651860992:12345-0@lo:400:kworker.0 Request processed in 32us (2878us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823565.293595:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1787823565.293662:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7926247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651860992:0@lo:400:kworker.0 00010000:00080000:0.0:1787823565.293678:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e793a4c8000 x1874668651861632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823565.293704:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651861632:0@lo:400:kworker.0 00010000:00080000:2.0:1787823565.293830:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e791ad52d00 x1874668651861376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823565.293842:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ad52d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651861376:0@lo:400:kworker.0 00000100:00100000:1.0:1787823565.294081:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939dc0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874668651861248:12345-0@lo:400:kworker.0 Request processed in 1888us (2567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823565.294090:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:1.0:1787823565.294116:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787823565.294122:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787823565.294125:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787823565.294415:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7926244b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874668651861248:0@lo:400:kworker.0 00000004:00080000:2.0:1787823565.802377:0:7935:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 306656614421ns, next at 307656611711ns, rc = 0 00000100:00100000:0.0:1787823565.802475:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7939dc2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651861760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787823565.802553:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823565.802806:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651861760 00000100:00100000:2.0:1787823565.802814:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651861760 00000100:00100000:2.0:1787823565.802868:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787823565.802878:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651861760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787823565.802914:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787823565.802978:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651861760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823565.802986:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1787823565.803095:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7939dc2580 x1874668651861760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823581 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823565.803114:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7939dc2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651861760:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787823566.057997:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787823567.004720:0:11617:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1787823567.094582:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787823567.943749:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967300 is committed 00000001:00080000:2.0:1787823567.943838:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1787823567.943928:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000004:00080000:2.0:1787823567.943982:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:0.0:1787823567.944162:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787823567.944284:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651861888:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787823567.944353:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823567.944495:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651861888 00000100:00100000:2.0:1787823567.944503:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651861888 00000100:00100000:2.0:1787823567.944617:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787823567.944626:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651861888:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787823567.944680:0:6688:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1787823567.944738:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9005cb, atime: 0x6a9005cb, ctime: 0x6a9005cb, blocks: 0x1 00010000:00010000:2.0:1787823567.944746:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2c23d9b/0x5d1142b83248191e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787823567.944835:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787823567.944911:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=308s v=(0 0) 00010000:00010000:2.0:1787823567.944917:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823567.944924:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2c23d9b/0x5d1142b83248191e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823567.944942:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2c23d9b/0x5d1142b83248191e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823567.944952:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2c23d9b/0x5d1142b83248191e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823567.944960:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2c23d9b/0x5d1142b83248191e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823567.945086:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787823567.945677:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1874668651861888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1051us (1323us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787823567.945704:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1787823567.946114:0:7630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787823567.946122:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2c23d9b/0x5d1142b83248191e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823567.946132:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d2800 already unused, calling callback (ffffffffc1649440) 00010000:00010000:0.0:1787823567.946154:0:7630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2c23d9b/0x5d1142b83248191e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823567.946165:0:7630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2c23d9b/0x5d1142b83248191e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823567.946238:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2c23d9b/0x5d1142b83248191e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823567.946247:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2c23d9b/0x5d1142b83248191e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823567.946265:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823567.946267:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823567.946269:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787823567.948629:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e793a4c92c0/2, rc 0, transno 4294967300 00000100:00100000:1.0:1787823567.948644:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651861888:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1787823568.111896:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787823568.162269:0:11667:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec048a680 20000000:00000080:2.0:1787823568.162287:0:11667:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e79182d9400 uarg=0000000000000000 20000000:01000000:2.0:1787823568.162321:0:11667:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1787823568.162327:0:11667:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1787823568.162332:0:11667:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1787823568.169021:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1787823568.169206:0:11667:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1787823568.175012:0:11667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1787823568.175085:0:11667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1787823568.175141:0:11667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1787823568.175162:0:11667:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787823568.175195:0:11667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e79358d2800/0x5d1142b832481925 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823568.175220:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e793a2f2600/0x5d1142b8324817c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4467e expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823568.175229:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e79013a3800/0x5d1142b8324817ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b8324817c7 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823568.175236:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e793a2f3600/0x5d1142b8324817dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b8324817d5 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823568.175243:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e793a2f2a00/0x5d1142b8324817e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44685 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823568.175250:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e79013a2000/0x5d1142b8324817f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b8324817ea expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823568.175257:0:11667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e79358d2800/0x5d1142b832481925 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823568.175309:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e79013a2000/0x5d1142b8324817f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d1142b8324817ea expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823568.175328:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e79013a2000/0x5d1142b8324817f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d1142b8324817ea expref: 18 pid: 5833 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823568.175346:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7939dc2580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1874668651862016:0@lo:104: 00000100:00100000:2.0:1787823568.175424:0:11667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787823568.175496:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e793a2f2a00/0x5d1142b8324817e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44685 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823568.175506:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e793a2f2a00/0x5d1142b8324817e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44685 expref: 12 pid: 5831 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823568.175516:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922b8b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1874668651862144:192.168.202.35@tcp:104: 00000100:00100000:1.0:1787823568.176015:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651862016 00000100:00100000:1.0:1787823568.176022:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651862016 00000100:00100000:1.0:1787823568.176077:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787823568.176086:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ac84f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+3:11667:x1874668651862016:12345-0@lo:104: 00010000:00010000:1.0:1787823568.176099:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff8e79013a2400/0x5d1142b8324817ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b8324817f1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823568.176152:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787823568.176158:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ac84f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+3:11667:x1874668651862016:12345-0@lo:104: Request processed in 74us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823568.176165:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1787823568.177736:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e793a2f3600/0x5d1142b8324817dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d1142b8324817d5 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823568.177752:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e793a2f3600/0x5d1142b8324817dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d1142b8324817d5 expref: 18 pid: 5831 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823568.177790:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793f9be580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1874668651862272:0@lo:104: 00000100:00100000:2.0:1787823568.177840:0:11667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787823568.177871:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e79013a3800/0x5d1142b8324817ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d1142b8324817c7 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823568.177879:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e79013a3800/0x5d1142b8324817ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d1142b8324817c7 expref: 18 pid: 5832 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823568.177898:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793f9bd680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1874668651862400:0@lo:104: 00000100:00100000:2.0:1787823568.177920:0:11667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787823568.177995:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e793a2f2600/0x5d1142b8324817c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4467e expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823568.178005:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e793a2f2600/0x5d1142b8324817c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4467e expref: 12 pid: 5833 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823568.178015:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793f9bc780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1874668651862528:192.168.202.35@tcp:104: 00000100:00100000:2.0:1787823568.178058:0:11667:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e792e7270c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787823568.178079:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7939dc2580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1874668651862016:0@lo:104: 00010000:00010000:3.0:1787823568.178291:0:7629:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787823568.178298:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e79013a2400/0x5d1142b8324817ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b8324817f1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823568.178307:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79013a2400 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:3.0:1787823568.178311:0:7629:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e79013a2400/0x5d1142b8324817ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d1142b8324817f1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823568.178320:0:7629:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e79013a2400/0x5d1142b8324817ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d1142b8324817f1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787823568.178328:0:7629:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e79013a2400/0x5d1142b8324817ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d1142b8324817f1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787823568.178343:0:7629:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787823568.178371:0:7629:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e79013a2400/0x5d1142b8324817ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b8324817f1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823568.178377:0:7629:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787823568.178395:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e79013a2400/0x5d1142b8324817ea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b8324817f1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823568.178401:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e79013a2400/0x5d1142b8324817ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b8324817f1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823568.178413:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823568.178415:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823568.178416:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823568.178433:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651862656:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787823568.178468:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823568.178501:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651862656 00000100:00100000:3.0:1787823568.178506:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651862656 00010000:00010000:3.0:1787823568.178528:0:7631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e79013a2000/0x5d1142b8324817f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b8324817ea expref: 19 pid: 5833 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823568.178552:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787823568.178561:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea89e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3305:x1874668651862656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787823568.178573:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787823568.178578:0:7631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e79013a2000/0x5d1142b8324817f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b8324817ea expref: 19 pid: 5833 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823568.178587:0:7631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e79013a2000/0x5d1142b8324817f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d1142b8324817ea expref: 19 pid: 5833 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823568.178607:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e79013a2000/0x5d1142b8324817f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d1142b8324817ea expref: 19 pid: 5833 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823568.178620:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787823568.178652:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea89e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:3305:x1874668651862656:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823568.178660:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787823568.178690:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651862656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787823568.179024:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787823568.179035:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651862272 00000100:00100000:0.0:1787823568.179048:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651862272 00000100:00100000:0.0:1787823568.179067:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651862400 00000100:00100000:0.0:1787823568.179069:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651862400 00000100:00100000:0.0:1787823568.179080:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787823568.179085:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+4:11667:x1874668651862272:12345-0@lo:104: 00010000:00010000:0.0:1787823568.179095:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff8e79358d2a00/0x5d1142b8324817d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b8324817dc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823568.179152:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787823568.179158:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+4:11667:x1874668651862272:12345-0@lo:104: Request processed in 73us (1319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823568.179165:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787823568.179178:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787823568.183475:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793f9be580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1874668651862272:0@lo:104: 00000100:00100000:0.0:1787823568.184014:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f98b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+3:11667:x1874668651862400:12345-0@lo:104: 00010000:00010000:0.0:1787823568.184032:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff8e79358d3a00/0x5d1142b8324817c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b8324817ce expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823568.184147:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787823568.184152:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f98b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+3:11667:x1874668651862400:12345-0@lo:104: Request processed in 155us (6232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823568.184160:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1787823568.184226:0:7630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787823568.184233:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e79358d2a00/0x5d1142b8324817d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b8324817dc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823568.184241:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d2a00 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:0.0:1787823568.184245:0:7630:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e79358d2a00/0x5d1142b8324817d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d1142b8324817dc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823568.184253:0:7630:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e79358d2a00/0x5d1142b8324817d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d1142b8324817dc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787823568.184260:0:7630:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e79358d2a00/0x5d1142b8324817d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d1142b8324817dc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787823568.184266:0:7630:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787823568.184316:0:7630:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e79358d2a00/0x5d1142b8324817d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b8324817dc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823568.184323:0:7630:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787823568.184340:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e79358d2a00/0x5d1142b8324817d5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b8324817dc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823568.184346:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e79358d2a00/0x5d1142b8324817d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b8324817dc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823568.184360:0:7630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787823568.184362:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e79358d3a00/0x5d1142b8324817c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b8324817ce expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823568.184367:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3a00 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:0.0:1787823568.184370:0:7630:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e79358d3a00/0x5d1142b8324817c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d1142b8324817ce expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823568.184376:0:7630:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e79358d3a00/0x5d1142b8324817c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d1142b8324817ce expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787823568.184383:0:7630:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e79358d3a00/0x5d1142b8324817c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d1142b8324817ce expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787823568.184388:0:7630:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787823568.184401:0:7630:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e79358d3a00/0x5d1142b8324817c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b8324817ce expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823568.184407:0:7630:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787823568.184430:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e79358d3a00/0x5d1142b8324817c7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b8324817ce expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823568.184447:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e79358d3a00/0x5d1142b8324817c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b8324817ce expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823568.184461:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823568.184463:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823568.184465:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787823568.184528:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793f9bd680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1874668651862400:0@lo:104: 00010000:00010000:3.0:1787823568.184658:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823568.184681:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651862784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787823568.184724:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823568.184937:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787823568.184946:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3308:1874668651862912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787823568.184975:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823568.185063:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651862784 00000100:00100000:3.0:1787823568.185069:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651862784 00010000:00010000:3.0:1787823568.185093:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e793a2f3600/0x5d1142b8324817dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b8324817d5 expref: 18 pid: 5831 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823568.185115:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651862912 00000100:00100000:3.0:1787823568.185119:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651862912 00010000:00010000:3.0:1787823568.185130:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e79013a3800/0x5d1142b8324817ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b8324817c7 expref: 19 pid: 5832 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823568.185149:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787823568.185156:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3306:x1874668651862784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787823568.185167:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787823568.185180:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e793a2f3600/0x5d1142b8324817dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b8324817d5 expref: 19 pid: 5831 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823568.185189:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e793a2f3600/0x5d1142b8324817dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d1142b8324817d5 expref: 19 pid: 5831 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823568.185204:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e793a2f3600/0x5d1142b8324817dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d1142b8324817d5 expref: 19 pid: 5831 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823568.185216:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787823568.185244:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:3306:x1874668651862784:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823568.185251:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787823568.185265:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787823568.185270:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909a21c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:3308:x1874668651862912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787823568.185278:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787823568.185282:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e79013a3800/0x5d1142b8324817ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b8324817c7 expref: 17 pid: 5832 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823568.185289:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e79013a3800/0x5d1142b8324817ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d1142b8324817c7 expref: 17 pid: 5832 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823568.185298:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e79013a3800/0x5d1142b8324817ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d1142b8324817c7 expref: 17 pid: 5832 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823568.185308:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787823568.185333:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909a21c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+16:3308:x1874668651862912:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823568.185338:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787823568.185388:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3308:1874668651862912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787823568.185419:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651862784:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787823568.185544:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823568.185564:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823568.185702:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629808512 00000100:00100000:0.0:1787823568.185706:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629808512 00010000:00010000:0.0:1787823568.185724:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e793a2f2a00/0x5d1142b8324817e3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44685 expref: 13 pid: 5831 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823568.185750:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629808640 00000100:00100000:0.0:1787823568.185754:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629808640 00010000:00010000:0.0:1787823568.185788:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e793a2f2600/0x5d1142b8324817c0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4467e expref: 14 pid: 5833 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823568.185804:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 33 00000100:00100000:0.0:1787823568.185811:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29690577-71bc-48f4-b24d-bdb875faaf85+14:2352:x1874668629808512:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787823568.185819:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787823568.185824:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e793a2f2a00/0x5d1142b8324817e3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44685 expref: 14 pid: 5831 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823568.185833:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e793a2f2a00/0x5d1142b8324817e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44685 expref: 14 pid: 5831 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823568.185844:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787823568.185879:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29690577-71bc-48f4-b24d-bdb875faaf85+14:2352:x1874668629808512:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 69us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823568.185895:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 33 00000100:00100000:0.0:1787823568.185908:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 34 00000100:00100000:0.0:1787823568.185914:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29690577-71bc-48f4-b24d-bdb875faaf85+13:2352:x1874668629808640:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787823568.185922:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787823568.185926:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e793a2f2600/0x5d1142b8324817c0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4467e expref: 13 pid: 5833 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823568.185935:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e793a2f2600/0x5d1142b8324817c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4467e expref: 13 pid: 5833 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823568.185947:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e79358d2800/0x5d1142b832481925 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823568.185955:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e79358d2800/0x5d1142b832481925 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823568.185968:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e79358d2800/0x5d1142b832481925 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823568.185975:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e79358d2800/0x5d1142b832481925 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823568.185982:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e79358d2800/0x5d1142b832481925 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823568.185990:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e79358d2800/0x5d1142b832481925 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823568.185995:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d2800 already unused, calling callback (ffffffffc1649440) 00010000:00010000:0.0:1787823568.186005:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e79358d2800/0x5d1142b832481925 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823568.186013:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e79358d2800/0x5d1142b832481925 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823568.186021:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e79358d2800/0x5d1142b832481925 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823568.186032:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787823568.186062:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29690577-71bc-48f4-b24d-bdb875faaf85+13:2352:x1874668629808640:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 148us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823568.186068:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 34 00010000:00010000:3.0:1787823568.186287:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e793a2f2a00/0x5d1142b8324817e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44685 expref: 12 pid: 5831 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823568.186297:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922b8b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1874668651862144:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787823568.186308:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e793a2f2600/0x5d1142b8324817c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4467e expref: 11 pid: 5833 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823568.186315:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793f9bc780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1874668651862528:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787823568.186394:0:11667:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e79358d2800/0x5d1142b832481925 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823568.186403:0:11667:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e79358d2800/0x5d1142b832481925 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823568.186408:0:11667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e79358d2800/0x5d1142b832481925 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823568.186415:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e79358d2800/0x5d1142b832481925 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823568.362096:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787823568.362121:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651863040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787823568.362195:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823568.362311:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651863040 00000100:00100000:0.0:1787823568.362319:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651863040 00000100:00100000:0.0:1787823568.362380:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787823568.362389:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651863040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787823568.362431:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787823568.362474:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651863040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823568.362481:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1787823568.362587:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787823568.362645:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e793a4c9680 x1874668651863040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823584 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823568.362664:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651863040:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787823569.129968:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787823569.513882:0:5835:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787823569.513890:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e7903710800 from 7 10000000:01000000:3.0:1787823569.513896:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787823569.513946:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7900030000/0x5d1142b83248192c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823569.513959:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e7900030000/0x5d1142b83248192c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823569.513983:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e7900030000/0x5d1142b83248192c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823569.514007:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea89e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651863168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787823569.514082:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823569.514208:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a47a300 going to sleep for 11 seconds 00000100:00100000:0.0:1787823569.514358:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651863168 00000100:00100000:0.0:1787823569.514365:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651863168 00000100:00100000:0.0:1787823569.514424:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1787823569.514433:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+16:5835:x1874668651863168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787823569.514446:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823569.514459:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e793a40ee00/0x5d1142b832481933 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b83248192c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823569.514494:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e793a40ee00/0x5d1142b832481933 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b83248192c expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823569.514504:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e793a40ee00/0x5d1142b832481933 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b83248192c expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823569.514513:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40ee00, rc 0) 00000100:00100000:0.0:1787823569.514560:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:5835:x1874668651863168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823569.514568:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1787823569.514909:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea89e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651863168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787823569.514923:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e7900030000/0x5d1142b83248192c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481933 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823569.514933:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e7900030000/0x5d1142b83248192c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b832481933 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823569.514985:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea89e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651863296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787823569.515012:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823569.515078:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651863296 00000100:00100000:0.0:1787823569.515082:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651863296 00000100:00100000:0.0:1787823569.515111:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1787823569.515118:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:5835:x1874668651863296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787823569.515331:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:5835:x1874668651863296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 213us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823569.515338:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1787823569.517418:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a47a300 going to sleep for 11 seconds 00000100:00100000:3.0:1787823569.517461:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea89e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651863296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787823569.517517:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea89e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651863424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787823569.517597:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823569.517634:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a47a300 going to sleep for 11 seconds 00000100:00100000:2.0:1787823569.517849:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651863424 00000100:00100000:2.0:1787823569.517856:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651863424 00000100:00100000:2.0:1787823569.517902:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787823569.517912:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:5835:x1874668651863424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787823569.518125:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:5835:x1874668651863424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 213us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823569.518132:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1787823569.518543:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea89e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651863424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787823569.519266:0:11680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea89e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:11680:1874668651863552:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787823569.519415:0:11680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823569.519450:0:11680:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a47a480 going to sleep for 11 seconds 00000100:00100000:0.0:1787823569.519724:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651863552 00000100:00100000:0.0:1787823569.519732:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651863552 00000100:00100000:0.0:1787823569.519794:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1787823569.519803:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7908c44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:11680:x1874668651863552:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787823569.519981:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7908c44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:11680:x1874668651863552:12345-0@lo:502:llog_process_th.0 Request processed in 178us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823569.519987:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1787823569.520572:0:11680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea89e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:11680:1874668651863552:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787823569.520601:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787823569.520611:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787823569.520614:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787823569.520621:0:11680:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e7903710800 00000020:00000080:3.0:1787823569.520623:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787823569.520721:0:11680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea89e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:11680:1874668651863680:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787823569.520781:0:11680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823569.520809:0:11680:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a47a480 going to sleep for 11 seconds 00000100:00100000:0.0:1787823569.524216:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651863680 00000100:00100000:0.0:1787823569.524233:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651863680 00000100:00100000:0.0:1787823569.524295:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787823569.524305:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7908c45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:11680:x1874668651863680:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787823569.524740:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7908c45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:11680:x1874668651863680:12345-0@lo:502:llog_process_th.0 Request processed in 436us (3958us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823569.524748:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787823569.524842:0:11680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea89e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:11680:1874668651863680:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787823569.524872:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787823569.524879:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787823569.524881:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787823569.524886:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787823569.524950:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787823569.524964:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787823569.524973:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7900030000/0x5d1142b83248192c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481933 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823569.524984:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e7900030000/0x5d1142b83248192c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481933 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787823569.524994:0:5835:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787823569.524997:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e7909bc2800 from 7 10000000:01000000:0.0:1787823569.524999:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787823569.525037:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a40e800/0x5d1142b83248193a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823569.525045:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e793a40e800/0x5d1142b83248193a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823569.525054:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e793a40e800/0x5d1142b83248193a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823569.525084:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4cad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651863808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787823569.530359:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823569.531806:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651863808 00000100:00100000:1.0:1787823569.531820:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651863808 00000100:00100000:1.0:1787823569.531877:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787823569.531887:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:5835:x1874668651863808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787823569.531905:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823569.531924:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e793a2f2000/0x5d1142b832481941 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b83248193a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823569.531951:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e793a2f2000/0x5d1142b832481941 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b83248193a expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823569.531976:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e793a2f2000/0x5d1142b832481941 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b83248193a expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823569.531985:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a2f2000, rc 0) 00000100:00100000:1.0:1787823569.537201:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:5835:x1874668651863808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 5305us (6839us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823569.537222:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787823569.545149:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a30c240 going to sleep for 11 seconds 00000100:00100000:0.0:1787823569.545201:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4cad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651863808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787823569.545232:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e793a40e800/0x5d1142b83248193a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481941 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823569.545254:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e793a40e800/0x5d1142b83248193a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b832481941 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823569.545325:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4cad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651863936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787823569.545398:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823569.545715:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a30c240 going to sleep for 11 seconds 00000100:00100000:1.0:1787823569.545811:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651863936 00000100:00100000:1.0:1787823569.545819:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651863936 00000100:00100000:1.0:1787823569.545863:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787823569.545872:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:5835:x1874668651863936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787823569.546170:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:5835:x1874668651863936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 297us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823569.546179:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1787823569.546375:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4cad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651863936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787823569.546415:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4cad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651864064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787823569.546451:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823569.546475:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a30c240 going to sleep for 11 seconds 00000100:00100000:1.0:1787823569.546792:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651864064 00000100:00100000:1.0:1787823569.546798:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651864064 00000100:00100000:1.0:1787823569.546827:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787823569.546833:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:5835:x1874668651864064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787823569.546977:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:5835:x1874668651864064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823569.546984:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787823569.547078:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4cad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651864064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787823569.554231:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4cad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:11683:1874668651864192:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787823569.554329:0:11683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823569.554370:0:11683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a30cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787823569.554472:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651864192 00000100:00100000:1.0:1787823569.554480:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651864192 00000100:00100000:1.0:1787823569.554526:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787823569.554536:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:11683:x1874668651864192:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787823569.554755:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:11683:x1874668651864192:12345-0@lo:502:llog_process_th.0 Request processed in 220us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823569.554792:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787823569.555111:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4cad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:11683:1874668651864192:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787823569.555141:0:11683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787823569.555156:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787823569.555160:0:11683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787823569.555167:0:11683:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e7909bc2800 00000020:00000080:0.0:1787823569.555169:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787823569.555248:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4cad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:11683:1874668651864320:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787823569.555718:0:11683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823569.555755:0:11683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a30cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787823569.555849:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651864320 00000100:00100000:2.0:1787823569.555855:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651864320 00000100:00100000:2.0:1787823569.555887:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787823569.555895:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:11683:x1874668651864320:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787823569.556164:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:11683:x1874668651864320:12345-0@lo:502:llog_process_th.0 Request processed in 270us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823569.556172:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787823569.556249:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4cad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:11683:1874668651864320:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787823569.556273:0:11683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787823569.556279:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787823569.556281:0:11683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787823569.556284:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787823569.556507:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787823569.556524:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787823569.556533:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a40e800/0x5d1142b83248193a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481941 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823569.556545:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e793a40e800/0x5d1142b83248193a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481941 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787823569.556555:0:5835:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787823569.556558:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e79034dc800 from 7 10000000:01000000:2.0:1787823569.556561:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787823569.556588:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e79358d3000/0x5d1142b832481948 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823569.556597:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e79358d3000/0x5d1142b832481948 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823569.556605:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e79358d3000/0x5d1142b832481948 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823569.556630:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793f9bde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651864448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787823569.556660:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823569.556687:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e792e7279c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787823569.556728:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651864448 00000100:00100000:1.0:1787823569.556733:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651864448 00000100:00100000:1.0:1787823569.556786:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1787823569.556794:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:5835:x1874668651864448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787823569.556810:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823569.556822:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e793a2f3400/0x5d1142b83248194f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b832481948 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823569.556842:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e793a2f3400/0x5d1142b83248194f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b832481948 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823569.556852:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e793a2f3400/0x5d1142b83248194f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832481948 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823569.556860:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a2f3400, rc 0) 00000100:00100000:1.0:1787823569.556895:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:5835:x1874668651864448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823569.556901:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1787823569.556970:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793f9bde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651864448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787823569.557061:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e79358d3000/0x5d1142b832481948 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248194f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823569.557071:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e79358d3000/0x5d1142b832481948 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b83248194f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823569.557115:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4cad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651864576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787823569.557139:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823569.557159:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a30cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787823569.557198:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651864576 00000100:00100000:1.0:1787823569.557201:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651864576 00000100:00100000:1.0:1787823569.557260:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787823569.557267:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:5835:x1874668651864576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787823569.557473:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:5835:x1874668651864576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 205us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823569.557480:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000040:00080000:3.0:1787823569.559418:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787823569.565708:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4cad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651864576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787823569.565813:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4cad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651864704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787823569.565902:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823569.565951:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a30cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787823569.566055:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651864704 00000100:00100000:3.0:1787823569.566061:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651864704 00000100:00100000:3.0:1787823569.566105:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787823569.566114:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:5835:x1874668651864704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787823569.566318:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:5835:x1874668651864704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 203us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823569.566325:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787823569.566753:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4cad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:5835:1874668651864704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787823569.567314:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4cad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:11685:1874668651864832:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787823569.567371:0:11685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823569.567395:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a30c840 going to sleep for 11 seconds 00000100:00100000:3.0:1787823569.567468:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651864832 00000100:00100000:3.0:1787823569.567473:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651864832 00000100:00100000:3.0:1787823569.567500:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787823569.567507:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:11685:x1874668651864832:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787823569.567669:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:11685:x1874668651864832:12345-0@lo:502:llog_process_th.0 Request processed in 162us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823569.567676:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787823569.567743:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4cad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:11685:1874668651864832:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787823569.567879:0:11685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787823569.567889:0:11685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787823569.567892:0:11685:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787823569.567898:0:11685:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e79034dc800 00000020:00000080:0.0:1787823569.567901:0:11685:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787823569.567969:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4cad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:11685:1874668651864960:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787823569.568011:0:11685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823569.568041:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a30c840 going to sleep for 11 seconds 00000100:00100000:3.0:1787823569.568167:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651864960 00000100:00100000:3.0:1787823569.568172:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651864960 00000100:00100000:3.0:1787823569.568189:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787823569.568201:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:11685:x1874668651864960:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787823569.568322:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:11685:x1874668651864960:12345-0@lo:502:llog_process_th.0 Request processed in 119us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823569.568328:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787823569.568420:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4cad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:11685:1874668651864960:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787823569.568437:0:11685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787823569.568441:0:11685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787823569.568442:0:11685:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787823569.568446:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787823569.568591:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787823569.568610:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787823569.568620:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e79358d3000/0x5d1142b832481948 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248194f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823569.568630:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e79358d3000/0x5d1142b832481948 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248194f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823569.617611:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823569.617649:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823569.617678:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823569.617701:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823569.617727:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629808768 00000100:00100000:1.0:1787823569.617736:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629808768 00000100:00100000:1.0:1787823569.617801:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 266 00000100:00100000:1.0:1787823569.617821:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+11:2352:x1874668629808768:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787823569.617891:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+11:2352:x1874668629808768:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 73us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823569.617898:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 266 00000100:00100000:1.0:1787823569.617928:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629809024 00000100:00100000:1.0:1787823569.617931:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629809024 00000100:00100000:1.0:1787823569.617977:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 60 00000100:00100000:1.0:1787823569.617984:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+5:2352:x1874668629809024:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787823569.618009:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+5:2352:x1874668629809024:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 26us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823569.618015:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 60 00000100:00080000:1.0:1787823569.618106:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787823569.618185:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629808896 00000100:00100000:0.0:1787823569.618189:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629808896 00000100:00080000:1.0:1787823569.618341:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787823569.619743:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629809152 00000100:00100000:0.0:1787823569.619773:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629809152 00000100:00080000:1.0:1787823569.620106:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787823569.620236:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 105 00000100:00100000:3.0:1787823569.620247:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+5:2353:x1874668629808896:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787823569.620332:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+5:2353:x1874668629808896:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 87us (2729us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823569.620340:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 105 00000100:00100000:3.0:1787823569.620358:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 106 00000100:00100000:3.0:1787823569.620364:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2353:x1874668629809152:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787823569.620385:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2353:x1874668629809152:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 22us (2736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823569.620390:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 106 00000100:00100000:1.0:1787823569.991838:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823569.995897:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629809280 00000100:00100000:2.0:1787823569.995911:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629809280 00000100:00100000:2.0:1787823569.995988:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 267 00000100:00100000:2.0:1787823569.995998:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+11:5595:x1874668629809280:12345-192.168.202.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787823569.996015:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823569.996045:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e79358d2e00/0x5d1142b832481956 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe697ab316f446d2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823569.996074:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e79358d2e00/0x5d1142b832481956 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446d2 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823569.996086:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e79358d2e00/0x5d1142b832481956 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446d2 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823569.996095:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d2e00, rc 0) 00000100:00100000:2.0:1787823569.996172:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+12:5595:x1874668629809280:12345-192.168.202.35@tcp:101:ll_cfg_requeue.0 Request processed in 175us (4343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823569.996179:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 267 00000100:00100000:1.0:1787823569.999054:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823569.999142:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629809408 00000100:00100000:2.0:1787823569.999151:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629809408 00000100:00100000:2.0:1787823569.999212:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 268 00000100:00100000:2.0:1787823569.999222:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+12:5595:x1874668629809408:12345-192.168.202.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787823569.999680:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+12:5595:x1874668629809408:12345-192.168.202.35@tcp:501:ll_cfg_requeue.0 Request processed in 458us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823569.999695:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 268 00000100:00100000:3.0:1787823570.008039:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823570.008139:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629809536 00000100:00100000:1.0:1787823570.008149:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629809536 00000100:00100000:1.0:1787823570.008210:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 269 00000100:00100000:1.0:1787823570.008219:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+12:5595:x1874668629809536:12345-192.168.202.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787823570.008579:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+12:5595:x1874668629809536:12345-192.168.202.35@tcp:503:ll_cfg_requeue.0 Request processed in 360us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823570.008588:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 269 00000100:00100000:1.0:1787823570.015081:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823570.015530:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629809664 00000100:00100000:2.0:1787823570.015540:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629809664 00000100:00100000:2.0:1787823570.015597:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 270 00000100:00100000:2.0:1787823570.015606:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+12:9954:x1874668629809664:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787823570.016001:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+12:9954:x1874668629809664:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 395us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823570.016009:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 270 00000100:00100000:0.0:1787823570.028587:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823570.028686:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629809792 00000100:00100000:1.0:1787823570.028695:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629809792 00000100:00100000:1.0:1787823570.028788:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 271 00000100:00100000:1.0:1787823570.028798:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+12:9954:x1874668629809792:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787823570.029049:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+12:9954:x1874668629809792:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 251us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823570.029057:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 271 00000100:00100000:3.0:1787823570.043431:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823570.043664:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629809920 00000100:00100000:2.0:1787823570.043675:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629809920 00000100:00100000:2.0:1787823570.043737:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 272 00000100:00100000:2.0:1787823570.043755:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+12:5595:x1874668629809920:12345-192.168.202.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787823570.043803:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823570.043819:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e79358d2000/0x5d1142b83248195d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe697ab316f446d9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823570.043845:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e79358d2000/0x5d1142b83248195d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446d9 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823570.043867:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e79358d2000/0x5d1142b83248195d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446d9 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823570.043878:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d2000, rc 0) 00000100:00100000:2.0:1787823570.043926:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+13:5595:x1874668629809920:12345-192.168.202.35@tcp:101:ll_cfg_requeue.0 Request processed in 181us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823570.043933:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 272 00000100:00100000:3.0:1787823570.047884:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823570.047973:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629810048 00000100:00100000:0.0:1787823570.047982:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629810048 00000100:00100000:0.0:1787823570.048045:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 273 00000100:00100000:0.0:1787823570.048055:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+13:5595:x1874668629810048:12345-192.168.202.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787823570.048483:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+13:5595:x1874668629810048:12345-192.168.202.35@tcp:501:ll_cfg_requeue.0 Request processed in 427us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823570.048498:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 273 00000100:00100000:0.0:1787823570.050491:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823570.061016:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629810176 00000100:00100000:1.0:1787823570.061042:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629810176 00000100:00100000:1.0:1787823570.061113:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 274 00000100:00100000:1.0:1787823570.061126:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+13:5595:x1874668629810176:12345-192.168.202.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787823570.061400:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+13:5595:x1874668629810176:12345-192.168.202.35@tcp:503:ll_cfg_requeue.0 Request processed in 275us (10915us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823570.061408:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 274 00000100:00100000:3.0:1787823570.068593:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823570.069065:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629810304 00000100:00100000:2.0:1787823570.069076:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629810304 00000100:00100000:2.0:1787823570.069138:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 275 00000100:00100000:2.0:1787823570.069149:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+13:9957:x1874668629810304:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787823570.069415:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+13:9957:x1874668629810304:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 267us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823570.069423:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 275 00000100:00100000:3.0:1787823570.077723:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823570.083854:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629810432 00000100:00100000:0.0:1787823570.083872:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629810432 00000100:00100000:0.0:1787823570.083959:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 276 00000100:00100000:0.0:1787823570.083971:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+13:9957:x1874668629810432:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787823570.084284:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+13:9957:x1874668629810432:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 315us (6570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823570.084292:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 276 00010000:00010000:3.0:1787823570.154888:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823570.410376:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874668651865216:0@lo:400:kworker.0 00000100:00100000:1.0:1787823570.410459:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823570.410522:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7935168000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651865728:0@lo:400:kworker.0 00000100:00100000:1.0:1787823570.410547:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823570.410581:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787823570.410588:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651865088:0@lo:400:kworker.0 00000100:00100000:1.0:1787823570.410626:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823570.410646:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874668651865600:0@lo:400:kworker.0 00000100:00100000:1.0:1787823570.410664:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823570.410688:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651865472:0@lo:400:kworker.0 00000100:00100000:1.0:1787823570.410706:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823570.410721:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787823570.410739:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874668651865344:0@lo:400:kworker.0 00000100:00100000:1.0:1787823570.410782:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823570.410813:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651865728 00000100:00100000:1.0:1787823570.410819:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651865728 00000100:00100000:1.0:1787823570.410864:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651865472 00000100:00100000:1.0:1787823570.410866:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651865472 00000100:00100000:1.0:1787823570.410881:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787823570.410890:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1874668651865728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823570.410938:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1874668651865728:12345-0@lo:400:kworker.0 Request processed in 49us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823570.410945:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787823570.410959:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787823570.410965:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651865472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823570.410990:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651865472:12345-0@lo:400:kworker.0 Request processed in 25us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823570.410995:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787823570.411013:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651865216 00000100:00100000:1.0:1787823570.411015:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651865216 00000100:00100000:1.0:1787823570.411062:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651865600 00000100:00100000:1.0:1787823570.411065:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651865600 00000100:00100000:1.0:1787823570.411075:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651865344 00000100:00100000:1.0:1787823570.411077:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651865344 00000100:00100000:1.0:1787823570.411089:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787823570.411095:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874668651865216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823570.411123:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874668651865216:12345-0@lo:400:kworker.0 Request processed in 27us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823570.411129:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787823570.411138:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787823570.411149:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874668651865600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823570.411172:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874668651865600:12345-0@lo:400:kworker.0 Request processed in 24us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823570.411178:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787823570.411187:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787823570.411191:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874668651865344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823570.411210:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874668651865344:12345-0@lo:400:kworker.0 Request processed in 19us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823570.411216:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:1.0:1787823570.411229:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787823570.411233:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787823570.411234:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787823570.411261:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874668651865344:0@lo:400:kworker.0 00010000:00080000:1.0:1787823570.411271:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e793a4ca580 x1874668651865472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787823570.411282:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651865472:0@lo:400:kworker.0 00000100:00100000:1.0:1787823570.411305:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874668651865600:0@lo:400:kworker.0 00000100:00100000:1.0:1787823570.411313:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874668651865216:0@lo:400:kworker.0 00000100:00100000:1.0:1787823570.411321:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7935168000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651865728:0@lo:400:kworker.0 00000100:00100000:1.0:1787823570.411337:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651865088 00000100:00100000:1.0:1787823570.411339:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651865088 00000100:00100000:1.0:1787823570.411358:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1787823570.411364:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3306:x1874668651865088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823570.411392:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3306:x1874668651865088:12345-0@lo:400:kworker.0 Request processed in 28us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823570.411403:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1787823570.411430:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651865088:0@lo:400:kworker.0 00000040:00080000:3.0:1787823570.603200:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787823570.937122:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793f9bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651865856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787823570.937214:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823570.940523:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651865856 00000100:00100000:1.0:1787823570.940541:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651865856 00000100:00100000:1.0:1787823570.940598:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787823570.940609:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7935168000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874668651865856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787823570.940648:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787823570.940717:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7935168000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874668651865856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (3504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823570.940724:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787823570.942961:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793f9bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651865856:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787823571.177920:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823572.202057:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787823573.166428:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:3.0:1787823573.227394:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823573.484083:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7926196580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651865984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787823573.484171:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823573.484347:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651865984 00000100:00100000:0.0:1787823573.484356:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651865984 00000100:00100000:0.0:1787823573.484433:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787823573.484444:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651865984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787823573.484482:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787823573.484535:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651865984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823573.484543:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1787823573.484854:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787823573.484887:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7926196580 x1874668651865984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823589 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787823573.484908:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7926196580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651865984:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787823574.250874:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823574.732283:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823574.732325:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823574.732365:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823574.732421:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823574.732561:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629810688 00000100:00100000:3.0:1787823574.732572:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629810688 00000100:00100000:3.0:1787823574.732640:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629810944 00000100:00100000:3.0:1787823574.732644:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629810944 00000100:00100000:3.0:1787823574.732672:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 110 00000100:00100000:3.0:1787823574.732683:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926196580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+5:2353:x1874668629810688:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787823574.732797:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926196580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+5:2353:x1874668629810688:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 116us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823574.732805:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 110 00000100:00100000:3.0:1787823574.732822:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 111 00000100:00100000:3.0:1787823574.732829:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ac84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2353:x1874668629810944:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787823574.732852:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ac84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2353:x1874668629810944:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 24us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823574.732857:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 111 00000100:00100000:1.0:1787823574.733236:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629810816 00000100:00100000:1.0:1787823574.733241:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629810816 00000100:00100000:1.0:1787823574.733278:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 63 00000100:00100000:1.0:1787823574.733287:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79262470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+5:2353:x1874668629810816:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787823574.733322:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79262470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+5:2353:x1874668629810816:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 37us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823574.733330:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 63 00000100:00100000:2.0:1787823574.733874:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629810560 00000100:00100000:2.0:1787823574.733879:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629810560 00000100:00100000:2.0:1787823574.733916:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 278 00000100:00100000:2.0:1787823574.733932:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+13:2353:x1874668629810560:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787823574.733974:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+13:2353:x1874668629810560:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 52us (1609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823574.733989:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 278 00000100:00080000:0.0:1787823574.735102:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787823574.735110:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787823575.273924:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823575.530426:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7926244b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651866112:0@lo:400:kworker.0 00000100:00100000:1.0:1787823575.530517:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7926247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874668651866240:0@lo:400:kworker.0 00000100:00100000:3.0:1787823575.530523:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823575.530679:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651866112 00000100:00100000:0.0:1787823575.530688:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651866112 00000100:00100000:0.0:1787823575.530750:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1787823575.530784:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3305:x1874668651866112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823575.530858:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7926245680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874668651866368:0@lo:400:kworker.0 00000100:00100000:1.0:1787823575.538667:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823575.538774:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792e808f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651866752:0@lo:400:kworker.0 00000100:00100000:1.0:1787823575.538837:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823575.538876:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787823575.538884:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ad52580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874668651866624:0@lo:400:kworker.0 00000100:00100000:1.0:1787823575.538907:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823575.538950:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651866752 00000100:00100000:1.0:1787823575.538957:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651866752 00000100:00100000:1.0:1787823575.539030:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787823575.539040:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651866752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823575.539097:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651866752:12345-0@lo:400:kworker.0 Request processed in 59us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823575.539105:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787823575.539127:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651866240 00000100:00100000:1.0:1787823575.539131:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651866240 00000100:00100000:1.0:1787823575.539155:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651866624 00000100:00100000:1.0:1787823575.539157:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651866624 00000100:00100000:1.0:1787823575.539177:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787823575.539183:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874668651866240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823575.539215:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874668651866240:12345-0@lo:400:kworker.0 Request processed in 32us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823575.539222:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787823575.539234:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787823575.539239:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874668651866624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823575.539264:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874668651866624:12345-0@lo:400:kworker.0 Request processed in 26us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823575.539270:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787823575.539312:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ad52d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651866496:0@lo:400:kworker.0 00000100:00080000:0.0:1787823575.539324:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787823575.539330:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787823575.539339:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823575.539387:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651866496 00000100:00100000:1.0:1787823575.539391:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651866496 00000100:00100000:1.0:1787823575.539418:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787823575.539424:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651866496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823575.539565:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3305:x1874668651866112:12345-0@lo:400:kworker.0 Request processed in 8797us (9032us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823575.539580:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1787823575.539645:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ad52580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874668651866624:0@lo:400:kworker.0 00000100:00100000:0.0:1787823575.539658:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7926247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874668651866240:0@lo:400:kworker.0 00000100:00100000:0.0:1787823575.539665:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1787823575.539670:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e793a4c92c0, transno 4294967300 00000100:00100000:0.0:1787823575.539681:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792e808f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651866752:0@lo:400:kworker.0 00000100:00080000:0.0:1787823575.539717:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787823575.559522:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823575.559620:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651866368 00000100:00100000:0.0:1787823575.559630:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651866368 00000100:00100000:0.0:1787823575.559700:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787823575.559710:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874668651866368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823575.559798:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874668651866368:12345-0@lo:400:kworker.0 Request processed in 90us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823575.559805:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:0.0:1787823575.559826:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787823575.561607:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7926245680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874668651866368:0@lo:400:kworker.0 00000100:00100000:2.0:1787823575.569115:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7926244b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651866112:0@lo:400:kworker.0 00000100:00100000:1.0:1787823575.578084:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651866496:12345-0@lo:400:kworker.0 Request processed in 38650us (38733us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823575.578100:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:2.0:1787823575.578277:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e791ad52d00 x1874668651866496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823591 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823575.578294:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ad52d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651866496:0@lo:400:kworker.0 00000100:00100000:1.0:1787823576.044529:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787823576.044562:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793f9be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651866880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787823576.044642:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823576.045210:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651866880 00000100:00100000:2.0:1787823576.045220:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651866880 00000100:00100000:2.0:1787823576.045322:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787823576.045348:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651866880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787823576.045400:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787823576.045461:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651866880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823576.045469:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787823576.045554:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793f9be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651866880:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787823576.298813:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823577.325137:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823578.347234:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823578.606566:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787823578.606589:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792e808f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651867008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787823578.606660:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823578.609603:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651867008 00000100:00100000:3.0:1787823578.609617:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651867008 00000100:00100000:3.0:1787823578.609704:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787823578.609715:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651867008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787823578.609776:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787823578.609861:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651867008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (3200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823578.609869:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1787823578.609890:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787823578.609928:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e792e808f00 x1874668651867008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823594 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823578.609966:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792e808f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651867008:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787823579.369952:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823579.847319:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823579.847364:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823579.847406:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823579.847509:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629811200 00000100:00100000:0.0:1787823579.847519:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629811200 00000100:00100000:0.0:1787823579.847599:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 115 00000100:00100000:0.0:1787823579.847610:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+5:2355:x1874668629811200:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787823579.847694:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+5:2355:x1874668629811200:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 85us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823579.847701:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 115 00000100:00100000:2.0:1787823579.847846:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629811328 00000100:00100000:2.0:1787823579.847851:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629811328 00000100:00100000:2.0:1787823579.847901:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 66 00000100:00080000:3.0:1787823579.847903:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787823579.847909:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787823579.847911:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+5:2355:x1874668629811328:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787823579.847966:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+5:2355:x1874668629811328:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 58us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823579.847975:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 66 00000100:00100000:3.0:1787823579.848339:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823579.848414:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629811456 00000100:00100000:2.0:1787823579.848418:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629811456 00000100:00100000:2.0:1787823579.848458:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 116 00000100:00100000:2.0:1787823579.848465:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2354:x1874668629811456:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787823579.848498:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2354:x1874668629811456:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 34us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823579.848504:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 116 00000100:00080000:3.0:1787823579.848582:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787823579.848644:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629811072 00000100:00100000:1.0:1787823579.848648:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629811072 00000100:00100000:1.0:1787823579.848685:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 280 00000100:00100000:1.0:1787823579.848693:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+13:2355:x1874668629811072:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787823579.848733:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+13:2355:x1874668629811072:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 40us (1424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823579.848740:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 280 00010000:00010000:3.0:1787823580.395577:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823580.659502:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea8a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874668651867264:0@lo:400:kworker.0 00000100:00100000:0.0:1787823580.659585:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823580.659656:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea88b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651867776:0@lo:400:kworker.0 00000100:00100000:0.0:1787823580.659683:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823580.659718:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787823580.659724:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea89a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651867136:0@lo:400:kworker.0 00000100:00100000:0.0:1787823580.659750:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823580.659793:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea8ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874668651867648:0@lo:400:kworker.0 00000100:00100000:0.0:1787823580.659814:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823580.659846:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651867776 00000100:00100000:0.0:1787823580.659854:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651867776 00000100:00100000:0.0:1787823580.659905:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787823580.659913:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651867776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823580.659977:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651867776:12345-0@lo:400:kworker.0 Request processed in 65us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823580.660130:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787823580.660157:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651867136 00000100:00100000:0.0:1787823580.660160:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651867136 00000100:00100000:0.0:1787823580.660183:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1787823580.660190:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3306:x1874668651867136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823580.660218:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3306:x1874668651867136:12345-0@lo:400:kworker.0 Request processed in 29us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823580.660225:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1787823580.660252:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651867264 00000100:00100000:0.0:1787823580.660255:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651867264 00000100:00100000:0.0:1787823580.660275:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651867648 00000100:00100000:0.0:1787823580.660278:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651867648 00000100:00100000:0.0:1787823580.660297:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787823580.660463:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874668651867392:0@lo:400:kworker.0 00000100:00100000:1.0:1787823580.660493:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823580.660510:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787823580.660515:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651867520:0@lo:400:kworker.0 00000100:00100000:1.0:1787823580.660535:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823580.660577:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651867520 00000100:00100000:1.0:1787823580.660580:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651867520 00000100:00100000:1.0:1787823580.660608:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787823580.660614:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651867520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823580.660649:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651867520:12345-0@lo:400:kworker.0 Request processed in 34us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823580.660654:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:1.0:1787823580.660686:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e792ea892c0 x1874668651867520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787823580.660699:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651867520:0@lo:400:kworker.0 00000100:00100000:1.0:1787823580.660743:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea89a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651867136:0@lo:400:kworker.0 00000100:00100000:1.0:1787823580.660753:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea88b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651867776:0@lo:400:kworker.0 00000100:00100000:0.0:1787823580.660849:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e809e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874668651867264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823580.661034:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651867392 00000100:00100000:2.0:1787823580.661038:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651867392 00000100:00100000:2.0:1787823580.661065:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787823580.661071:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874668651867648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823580.661131:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874668651867648:12345-0@lo:400:kworker.0 Request processed in 60us (1315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823580.661137:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787823580.661159:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787823580.661164:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874668651867392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823580.661198:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874668651867392:12345-0@lo:400:kworker.0 Request processed in 34us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823580.661205:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787823580.661239:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874668651867392:0@lo:400:kworker.0 00000100:00100000:1.0:1787823580.661569:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e809e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874668651867264:12345-0@lo:400:kworker.0 Request processed in 1265us (1983us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823580.661577:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:3.0:1787823580.661641:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787823580.661647:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787823580.661649:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787823580.662108:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea8ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874668651867648:0@lo:400:kworker.0 00000100:00100000:0.0:1787823580.662120:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea8a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874668651867264:0@lo:400:kworker.0 00000040:00080000:3.0:1787823580.842847:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787823581.164102:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787823581.164129:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793f9be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651867904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787823581.164209:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823581.164384:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651867904 00000100:00100000:2.0:1787823581.164393:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651867904 00000100:00100000:2.0:1787823581.164448:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787823581.164457:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651867904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787823581.164493:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787823581.164548:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651867904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823581.164556:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787823581.164643:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793f9be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651867904:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787823581.418176:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823582.442007:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823583.465918:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823583.722105:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792e80a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651868032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787823583.722206:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823583.722630:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651868032 00000100:00100000:0.0:1787823583.722640:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651868032 00000100:00100000:0.0:1787823583.722704:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787823583.722714:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651868032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787823583.722751:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787823583.722819:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651868032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823583.722838:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1787823583.722913:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787823583.722953:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e792e80a1c0 x1874668651868032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823599 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823583.722986:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792e80a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651868032:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787823584.490424:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823584.966425:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823584.966474:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823584.966534:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629811584 00000100:00100000:2.0:1787823584.966545:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629811584 00000100:00100000:0.0:1787823584.966577:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629811712 00000100:00100000:0.0:1787823584.966584:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629811712 00000100:00100000:2.0:1787823584.966613:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 282 00000100:00100000:2.0:1787823584.966624:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+13:2355:x1874668629811584:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787823584.966652:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 120 00000100:00100000:0.0:1787823584.966663:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+5:2355:x1874668629811712:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787823584.966698:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+13:2355:x1874668629811584:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 75us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823584.966705:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+5:2355:x1874668629811712:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 43us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823584.966710:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 282 00000100:00100000:0.0:1787823584.966716:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 120 00000100:00080000:3.0:1787823584.966920:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787823584.997279:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823584.997329:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823584.997417:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629811840 00000100:00100000:1.0:1787823584.997427:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629811840 00000100:00100000:1.0:1787823584.997491:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 19 00000100:00100000:1.0:1787823584.997499:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea88780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:353832f0-fe7b-4d99-975c-a8041babed42+5:2351:x1874668629811840:12345-192.168.202.35@tcp:9:kworker.0 00000020:00000080:1.0:1787823584.997527:0:6688:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d1142b832481899 00000100:00080000:1.0:1787823584.997534:0:6688:0:(import.c:65:import_set_state_nolock()) ffff8e793a4be800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787823584.997561:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1787823584.997797:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea88780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:353832f0-fe7b-4d99-975c-a8041babed42+2:2351:x1874668629811840:12345-192.168.202.35@tcp:9:kworker.0 Request processed in 298us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823584.997804:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 19 00010000:00010000:3.0:1787823584.998036:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787823584.998043:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787823584.999389:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629811968 00000100:00100000:0.0:1787823584.999402:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629811968 00000100:00100000:0.0:1787823584.999490:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 121 00000100:00100000:0.0:1787823584.999500:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2354:x1874668629811968:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787823584.999580:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2354:x1874668629811968:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 81us (2250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823584.999586:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 121 00000100:00080000:3.0:1787823585.000234:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787823585.514083:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823585.774470:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874668651868288:0@lo:400:kworker.0 00000100:00100000:0.0:1787823585.774543:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823585.774625:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651868800:0@lo:400:kworker.0 00000100:00100000:0.0:1787823585.774653:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823585.774681:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787823585.774686:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651868160:0@lo:400:kworker.0 00000100:00100000:0.0:1787823585.774714:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823585.774736:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874668651868672:0@lo:400:kworker.0 00000100:00100000:0.0:1787823585.774777:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823585.774825:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651868160 00000100:00100000:0.0:1787823585.774832:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651868160 00000100:00100000:0.0:1787823585.774873:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1787823585.774883:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3306:x1874668651868160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823585.774959:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3306:x1874668651868160:12345-0@lo:400:kworker.0 Request processed in 77us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823585.774966:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1787823585.774997:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651868288 00000100:00100000:0.0:1787823585.775001:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651868288 00000100:00100000:0.0:1787823585.775023:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651868672 00000100:00100000:0.0:1787823585.775026:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651868672 00000100:00100000:0.0:1787823585.775049:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787823585.775055:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e809a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874668651868288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823585.775096:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e809a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874668651868288:12345-0@lo:400:kworker.0 Request processed in 41us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823585.775103:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787823585.775115:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787823585.775121:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e8083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874668651868672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823585.775149:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e8083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874668651868672:12345-0@lo:400:kworker.0 Request processed in 29us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823585.775155:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787823585.775189:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651868160:0@lo:400:kworker.0 00000100:00100000:0.0:1787823585.775201:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874668651868672:0@lo:400:kworker.0 00000100:00100000:0.0:1787823585.775210:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874668651868288:0@lo:400:kworker.0 00000100:00100000:3.0:1787823585.775504:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874668651868416:0@lo:400:kworker.0 00000100:00100000:3.0:1787823585.775536:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823585.775564:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787823585.775570:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651868544:0@lo:400:kworker.0 00000100:00100000:3.0:1787823585.775605:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787823585.775640:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787823585.775736:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651868800 00000100:00100000:1.0:1787823585.775741:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651868800 00000100:00100000:1.0:1787823585.775805:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651868544 00000100:00100000:1.0:1787823585.775808:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651868544 00000100:00100000:1.0:1787823585.775826:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787823585.775833:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651868800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823585.775872:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651868800:12345-0@lo:400:kworker.0 Request processed in 40us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823585.775879:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787823585.775902:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787823585.775908:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651868544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823585.775938:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651868544:12345-0@lo:400:kworker.0 Request processed in 31us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823585.775945:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1787823585.776840:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787823585.776846:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787823585.776877:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e793a4ca1c0 x1874668651868544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823585.776900:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651868544:0@lo:400:kworker.0 00000100:00100000:0.0:1787823585.778698:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651868416 00000100:00100000:0.0:1787823585.778711:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651868416 00000100:00100000:0.0:1787823585.778829:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787823585.778838:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874668651868416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823585.778945:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874668651868416:12345-0@lo:400:kworker.0 Request processed in 108us (3408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823585.778952:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787823585.778998:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651868800:0@lo:400:kworker.0 00000100:00100000:2.0:1787823585.779097:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874668651868416:0@lo:400:kworker.0 00000100:00080000:3.0:1787823585.779265:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787823586.283056:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793f9bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651868928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787823586.283141:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823586.283423:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651868928 00000100:00100000:2.0:1787823586.283433:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651868928 00000100:00100000:2.0:1787823586.283488:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787823586.283498:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e8092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651868928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787823586.283549:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787823586.283599:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e8092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651868928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823586.283608:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787823586.283699:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793f9bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651868928:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787823586.539332:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823587.562021:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787823588.396523:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 353832f0-fe7b-4d99-975c-a8041babed42 00000020:00000080:3.0:1787823588.396533:0:7645:0:(genops.c:885:class_export_put()) final put ffff8e793a4bb800/353832f0-fe7b-4d99-975c-a8041babed42 00000020:00000080:3.0:1787823588.396577:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e793a4bb800/353832f0-fe7b-4d99-975c-a8041babed42 for lustre-OST0001 00000020:00000080:3.0:1787823588.396627:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e793a4be800 for lustre-OST0001 00010000:00010000:2.0:1787823588.586617:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787823588.842383:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787823588.842410:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792e80ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651869056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787823588.842487:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823588.842583:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651869056 00000100:00100000:0.0:1787823588.842591:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651869056 00000100:00100000:0.0:1787823588.842662:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787823588.842672:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651869056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787823588.842710:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787823588.842749:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651869056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823588.842774:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1787823588.842839:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787823588.842878:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e792e80ad00 x1874668651869056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823604 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823588.842897:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792e80ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651869056:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787823589.610668:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787823590.061935:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787823590.086658:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823590.086695:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823590.086729:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823590.086925:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629812096 00000100:00100000:0.0:1787823590.086935:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629812096 00000100:00100000:0.0:1787823590.086989:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 284 00000100:00100000:0.0:1787823590.087002:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+13:2355:x1874668629812096:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787823590.087093:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+13:2355:x1874668629812096:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 94us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823590.087101:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 284 00000100:00100000:1.0:1787823590.088156:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629812224 00000100:00100000:1.0:1787823590.088164:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629812224 00000100:00100000:1.0:1787823590.088218:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629812352 00000100:00100000:1.0:1787823590.088222:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629812352 00000100:00100000:1.0:1787823590.088252:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 125 00000100:00100000:1.0:1787823590.088261:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+5:2355:x1874668629812224:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787823590.088322:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+5:2355:x1874668629812224:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 62us (1677us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823590.088329:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 125 00000100:00100000:1.0:1787823590.088347:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 126 00000100:00100000:1.0:1787823590.088354:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea88b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2355:x1874668629812352:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787823590.088395:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea88b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2355:x1874668629812352:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 42us (1667us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823590.088402:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 126 00000100:00080000:3.0:1787823590.088639:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787823590.633948:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787823590.895196:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793f9bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874668651869440:0@lo:400:kworker.0 00000100:00100000:2.0:1787823590.895268:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823590.895332:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787823590.895339:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793f9be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651869568:0@lo:400:kworker.0 00000100:00100000:2.0:1787823590.895365:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823590.895666:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793f9bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651869184:0@lo:400:kworker.0 00000100:00100000:3.0:1787823590.895702:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823590.895727:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793f9bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874668651869696:0@lo:400:kworker.0 00000100:00100000:3.0:1787823590.895749:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823590.895789:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787823590.895796:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793f9bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874668651869312:0@lo:400:kworker.0 00000100:00100000:3.0:1787823590.895831:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823590.895861:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793f9be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651869824:0@lo:400:kworker.0 00000100:00100000:3.0:1787823590.895882:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823590.895926:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651869184 00000100:00100000:3.0:1787823590.895933:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651869184 00000100:00100000:3.0:1787823590.895980:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1787823590.895997:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909aa0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3305:x1874668651869184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823590.896045:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909aa0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3305:x1874668651869184:12345-0@lo:400:kworker.0 Request processed in 50us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823590.896052:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1787823590.896102:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651869440 00000100:00100000:3.0:1787823590.896107:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651869440 00000100:00100000:3.0:1787823590.896140:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651869696 00000100:00100000:3.0:1787823590.896143:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651869696 00000100:00100000:3.0:1787823590.896158:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651869312 00000100:00100000:3.0:1787823590.896160:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651869312 00000100:00100000:3.0:1787823590.896173:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787823590.896179:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874668651869440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823590.896217:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874668651869440:12345-0@lo:400:kworker.0 Request processed in 38us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823590.896224:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787823590.896237:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787823590.896242:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874668651869696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823590.896268:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874668651869696:12345-0@lo:400:kworker.0 Request processed in 26us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823590.896274:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787823590.896285:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787823590.896291:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea89e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874668651869312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823590.896316:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea89e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874668651869312:12345-0@lo:400:kworker.0 Request processed in 26us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823590.896322:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787823590.896343:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651869568 00000100:00100000:3.0:1787823590.896346:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651869568 00000100:00100000:3.0:1787823590.896369:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651869824 00000100:00100000:3.0:1787823590.896372:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651869824 00000100:00100000:3.0:1787823590.896385:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787823590.896391:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651869568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823590.896419:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651869568:12345-0@lo:400:kworker.0 Request processed in 28us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823590.896431:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787823590.896442:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787823590.896448:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651869824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823590.896473:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651869824:12345-0@lo:400:kworker.0 Request processed in 25us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823590.896479:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1787823590.896495:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787823590.896498:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787823590.896501:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787823590.896531:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e793f9be940 x1874668651869568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823590.896544:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793f9be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651869568:0@lo:400:kworker.0 00000100:00100000:3.0:1787823590.896556:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793f9bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874668651869440:0@lo:400:kworker.0 00000100:00100000:3.0:1787823590.896590:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793f9bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874668651869312:0@lo:400:kworker.0 00000100:00100000:3.0:1787823590.896599:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793f9be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651869824:0@lo:400:kworker.0 00000100:00100000:3.0:1787823590.896606:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793f9bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651869184:0@lo:400:kworker.0 00000100:00100000:3.0:1787823590.896614:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793f9bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874668651869696:0@lo:400:kworker.0 00000100:00100000:0.0:1787823591.406574:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787823591.410245:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793f9bc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651869952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787823591.410330:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823591.421262:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651869952 00000100:00100000:2.0:1787823591.421276:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651869952 00000100:00100000:2.0:1787823591.421336:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787823591.421356:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e808b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651869952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787823591.422817:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787823591.422951:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e808b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651869952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1603us (12618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823591.422963:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787823591.423545:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793f9bc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651869952:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787823591.666875:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823592.688572:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823593.707426:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787823593.790603:0:11849:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 05:39:52 (1787823592) 00000100:00100000:2.0:1787823593.963030:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792e808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651870080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787823593.963102:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823593.963177:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651870080 00000100:00100000:0.0:1787823593.963184:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651870080 00000100:00100000:0.0:1787823593.963231:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787823593.963239:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651870080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787823593.963272:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:2.0:1787823593.966157:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e792e808000 x1874668651870080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823609 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823593.966157:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651870080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2909us (3046us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823593.966170:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787823593.966184:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792e808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651870080:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787823593.966211:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787823594.729919:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823595.206519:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823595.206734:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629812608 00000100:00100000:1.0:1787823595.206755:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629812608 00000100:00100000:1.0:1787823595.206875:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 130 00000100:00100000:1.0:1787823595.206887:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea89a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+5:2353:x1874668629812608:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787823595.206975:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea89a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+5:2353:x1874668629812608:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 91us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823595.206983:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 130 00000100:00080000:0.0:1787823595.207347:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787823595.214611:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823595.214656:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823595.214735:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629812736 00000100:00100000:0.0:1787823595.214748:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629812480 00000100:00100000:3.0:1787823595.214749:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629812736 00000100:00100000:0.0:1787823595.214786:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629812480 00000100:00100000:0.0:1787823595.214856:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 286 00000100:00100000:3.0:1787823595.214864:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 131 00000100:00100000:0.0:1787823595.214870:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+13:2353:x1874668629812480:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787823595.214878:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2353:x1874668629812736:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787823595.214950:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+13:2353:x1874668629812480:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 84us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823595.214957:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 286 00000100:00100000:3.0:1787823595.215388:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2353:x1874668629812736:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 513us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823595.215397:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 131 00000100:00080000:1.0:1787823595.215401:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787823595.621097:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823595.621283:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629812864 00000100:00100000:3.0:1787823595.621295:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629812864 00000100:00100000:3.0:1787823595.621527:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 32 00000100:00100000:3.0:1787823595.621540:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+5:10225:x1874668629812864:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787823595.621567:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823595.621594:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031c00/0x5d1142b832481964 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f446e0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823595.621676:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030200/0x5d1142b83248196b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823595.621691:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030200/0x5d1142b83248196b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823595.621704:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030200/0x5d1142b83248196b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787823595.624575:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787823595.624587:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787823595.625010:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030200/0x5d1142b83248196b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823595.625053:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031c00/0x5d1142b832481964 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446e0 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823595.625074:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030200/0x5d1142b83248196b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446e0 expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823595.625092:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e79087c9600) 00010000:00010000:3.0:1787823595.625096:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787823595.625100:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7900030200, rc 0) 00000100:00100000:3.0:1787823595.625332:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+6:10225:x1874668629812864:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 3792us (4246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823595.625343:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 32 00000100:00100000:2.0:1787823595.641308:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823595.641600:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629812992 00000100:00100000:0.0:1787823595.641610:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629812992 00000100:00100000:0.0:1787823595.641678:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 33 00000100:00100000:0.0:1787823595.641689:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+6:10226:x1874668629812992:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787823595.641710:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823595.641747:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832481972 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f446e7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823595.641849:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481979 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823595.642066:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481979 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823595.642079:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481979 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823595.642095:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832481980 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823595.642102:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832481980 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823595.642108:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832481980 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823595.642690:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f200/0x5d1142b832481987 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823595.642703:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f200/0x5d1142b832481987 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823595.642711:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f200/0x5d1142b832481987 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787823595.642836:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787823595.642840:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787823595.643253:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f200/0x5d1142b832481987 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823595.643274:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481979 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823595.643281:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481979 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823595.643288:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481979 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823595.643294:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40e600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823595.643299:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481979 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823595.643306:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481979 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823595.643333:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e79087c9600) 00010000:00010000:0.0:1787823595.643336:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823595.643341:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481979 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823595.643347:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481979 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823595.643531:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832481980 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823595.643539:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832481980 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823595.643545:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832481980 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823595.643557:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40f600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823595.643560:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832481980 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823595.643567:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832481980 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823595.643577:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8e791767b200) 00010000:00010000:0.0:1787823595.643579:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823595.643583:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832481980 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823595.643589:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832481980 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823595.643629:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832481972 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446e7 expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823595.643643:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f200/0x5d1142b832481987 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446e7 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823595.643650:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e791767b400) 00010000:00010000:0.0:1787823595.643653:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787823595.643655:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40f200, rc 0) 00000100:00100000:0.0:1787823595.643848:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+7:10226:x1874668629812992:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 2159us (2549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823595.643874:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 33 00000100:00100000:2.0:1787823595.650745:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823595.651528:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629813248 00000100:00100000:1.0:1787823595.651541:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629813248 00000100:00100000:1.0:1787823595.651643:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 34 00000100:00100000:1.0:1787823595.651655:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+7:10226:x1874668629813248:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787823595.651676:0:7893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823595.651702:0:7893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b83248198e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f446ee expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823595.651836:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481995 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823595.651865:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481995 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823595.651893:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481995 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823595.651910:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248199c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823595.651917:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248199c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823595.651923:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248199c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823595.654701:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3000/0x5d1142b8324819a3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823595.654731:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3000/0x5d1142b8324819a3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823595.654744:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3000/0x5d1142b8324819a3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787823595.654781:0:7893:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787823595.659658:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481995 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823595.659675:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481995 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823595.659683:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481995 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823595.659690:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f3a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823595.661290:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481995 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823595.661302:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481995 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823595.661332:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e791767b400) 00010000:00010000:1.0:1787823595.661336:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823595.661342:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481995 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823595.661349:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481995 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823595.661380:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248199c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823595.661387:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248199c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823595.661394:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248199c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823595.661402:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f2e00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823595.661404:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248199c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823595.661410:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248199c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823595.661418:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8e7917859b00) 00010000:00010000:1.0:1787823595.661420:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823595.661436:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248199c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823595.661442:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248199c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823595.662110:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b83248198e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446ee expref: 10 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823595.662128:0:7893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3000/0x5d1142b8324819a3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446ee expref: 9 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823595.662136:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e7917859800) 00010000:00010000:1.0:1787823595.662139:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823595.662141:0:7893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a2f3000, rc 0) 00000100:00100000:1.0:1787823595.663586:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+9:10226:x1874668629813248:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 11924us (12842us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787823595.663600:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 34 00000100:00100000:3.0:1787823595.669540:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823595.669711:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629813376 00000100:00100000:0.0:1787823595.669737:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629813376 00000100:00100000:0.0:1787823595.669830:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 35 00000100:00100000:0.0:1787823595.669842:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+9:10226:x1874668629813376:12345-192.168.202.35@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787823595.669972:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+9:10226:x1874668629813376:12345-192.168.202.35@tcp:59:lhsmtool_posix.0 Request processed in 132us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823595.669980:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 35 00010000:00010000:3.0:1787823595.756565:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823596.010198:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7939dc2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874668651870464:0@lo:400:kworker.0 00000100:00100000:3.0:1787823596.010272:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823596.010408:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7939dc1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874668651870336:0@lo:400:kworker.0 00000100:00100000:2.0:1787823596.010440:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823596.010467:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a49da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651870592:0@lo:400:kworker.0 00000100:00100000:2.0:1787823596.010495:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823596.010533:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651870592 00000100:00100000:2.0:1787823596.010542:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651870592 00000100:00100000:2.0:1787823596.010606:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787823596.010617:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651870592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823596.010671:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651870592:12345-0@lo:400:kworker.0 Request processed in 56us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823596.010679:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1787823596.010701:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787823596.011008:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651870464 00000100:00100000:3.0:1787823596.011013:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651870464 00000100:00100000:3.0:1787823596.011048:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651870336 00000100:00100000:3.0:1787823596.011051:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651870336 00000100:00100000:3.0:1787823596.011069:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787823596.011077:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79360bb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874668651870464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823596.011117:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79360bb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874668651870464:12345-0@lo:400:kworker.0 Request processed in 42us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823596.011124:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787823596.011136:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787823596.011141:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874668651870336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823596.011168:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874668651870336:12345-0@lo:400:kworker.0 Request processed in 27us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823596.011174:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787823596.011217:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7939dc2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874668651870464:0@lo:400:kworker.0 00000100:00080000:2.0:1787823596.011407:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787823596.011444:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7939dc1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874668651870336:0@lo:400:kworker.0 00000100:00100000:2.0:1787823596.011453:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e79360b9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651870848:0@lo:400:kworker.0 00000100:00100000:2.0:1787823596.011480:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823596.011503:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787823596.011509:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922b8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651870208:0@lo:400:kworker.0 00000100:00100000:2.0:1787823596.011560:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823596.011586:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a49cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874668651870720:0@lo:400:kworker.0 00000100:00100000:2.0:1787823596.011608:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823596.011633:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651870208 00000100:00100000:2.0:1787823596.011637:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651870208 00000100:00100000:2.0:1787823596.011665:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1787823596.011671:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3306:x1874668651870208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823596.011704:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3306:x1874668651870208:12345-0@lo:400:kworker.0 Request processed in 33us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823596.011710:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1787823596.011737:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651870720 00000100:00100000:2.0:1787823596.011741:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651870720 00010000:00080000:3.0:1787823596.012016:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e793a49da40 x1874668651870592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787823612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823596.012029:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a49da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651870592:0@lo:400:kworker.0 00000100:00100000:3.0:1787823596.012068:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922b8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651870208:0@lo:400:kworker.0 00000100:00080000:3.0:1787823596.012088:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787823596.012493:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787823596.012505:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874668651870720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823596.012565:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874668651870720:12345-0@lo:400:kworker.0 Request processed in 65us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823596.012572:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787823596.012596:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651870848 00000100:00100000:1.0:1787823596.012600:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651870848 00000100:00100000:1.0:1787823596.012632:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787823596.012638:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651870848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823596.012668:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651870848:12345-0@lo:400:kworker.0 Request processed in 30us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823596.012683:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1787823596.012699:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787823596.012723:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a49cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874668651870720:0@lo:400:kworker.0 00000100:00100000:1.0:1787823596.012733:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e79360b9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651870848:0@lo:400:kworker.0 00000040:00080000:3.0:1787823596.202721:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787823596.530187:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787823596.530363:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793f9bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651870976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787823596.530442:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823596.530511:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651870976 00000100:00100000:2.0:1787823596.532692:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651870976 00000100:00100000:2.0:1787823596.532787:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787823596.532810:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651870976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787823596.532852:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787823596.533119:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651870976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 311us (2676us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823596.533126:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787823596.533186:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793f9bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651870976:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787823596.783356:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823597.807736:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823598.210663:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823598.211875:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629813504 00000100:00100000:2.0:1787823598.211890:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629813504 00000100:00100000:2.0:1787823598.211992:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 36 00000100:00100000:2.0:1787823598.212005:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79360b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+9:10269:x1874668629813504:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:2.0:1787823598.212027:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823598.212050:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3c00/0x5d1142b8324819b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f446f5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.212121:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324819b8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.212137:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324819b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.212152:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324819b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787823598.212323:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787823598.212356:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b8324819bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.212366:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b8324819bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.212374:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b8324819bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.212692:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324819b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.212701:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324819b8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.212707:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324819b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.212724:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823598.212729:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324819b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.212737:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324819b8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.212753:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e79087c9600) 00010000:00010000:2.0:1787823598.212842:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823598.212848:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324819b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.212856:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324819b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.212868:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b8324819bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.212875:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b8324819bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.212881:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b8324819bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.212887:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823598.212891:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b8324819bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.212896:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b8324819bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.212918:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8e79228da000) 00010000:00010000:2.0:1787823598.212921:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823598.212925:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b8324819bf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.212931:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b8324819bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.212970:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3c00/0x5d1142b8324819b1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446f5 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.212981:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e79087c9600) 00010000:00010000:2.0:1787823598.212983:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823598.212987:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3c00/0x5d1142b8324819b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446f5 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.212997:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d3c00, rc 0) 00000100:00100000:2.0:1787823598.213180:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79360b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+9:10269:x1874668629813504:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 1179us (2529us total) trans 0 rc 301/301 00000100:00100000:2.0:1787823598.213189:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 36 00000100:00100000:2.0:1787823598.232895:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823598.233238:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629813760 00000100:00100000:3.0:1787823598.233249:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629813760 00000100:00100000:3.0:1787823598.233377:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 37 00000100:00100000:3.0:1787823598.233388:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+9:10269:x1874668629813760:12345-192.168.202.35@tcp:36:lfs.0 00010000:00010000:3.0:1787823598.233452:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787823598.233481:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030200/0x5d1142b83248196b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446e0 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.233509:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e79087c9600) 00010000:00010000:3.0:1787823598.233521:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787823598.233864:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030400/0x5d1142b8324819c6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.233880:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030400/0x5d1142b8324819c6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.233890:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030400/0x5d1142b8324819c6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.233904:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031c00/0x5d1142b8324819cd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.233931:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031c00/0x5d1142b8324819cd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.233939:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031c00/0x5d1142b8324819cd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787823598.234993:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787823598.235008:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030400/0x5d1142b8324819c6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.235017:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030400/0x5d1142b8324819c6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.235024:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030400/0x5d1142b8324819c6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.235030:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7900030400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823598.235034:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030400/0x5d1142b8324819c6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.235041:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030400/0x5d1142b8324819c6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.235053:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e79087c9f00) 00010000:00010000:3.0:1787823598.235056:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787823598.235060:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030400/0x5d1142b8324819c6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.235065:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030400/0x5d1142b8324819c6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787823598.235100:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a472fec reply state 000000000e92430b transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031c00/0x5d1142b8324819cd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823598.235109:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787823598.235232:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+10:10269:x1874668629813760:12345-192.168.202.35@tcp:36:lfs.0 Request processed in 1843us (2345us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787823598.235241:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 37 00010000:00010000:3.0:1787823598.238404:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031c00/0x5d1142b8324819cd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.239163:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031c00/0x5d1142b8324819cd lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.239182:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031c00/0x5d1142b8324819cd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.239188:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7900031c00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823598.239193:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031c00/0x5d1142b8324819cd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.239202:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031c00/0x5d1142b8324819cd lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.239222:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8e79087c9300) 00010000:00010000:3.0:1787823598.239225:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787823598.239230:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031c00/0x5d1142b8324819cd lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.239237:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031c00/0x5d1142b8324819cd lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823598.363560:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823598.363721:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629813888 00000100:00100000:0.0:1787823598.363732:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629813888 00000100:00100000:0.0:1787823598.363850:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 38 00000100:00100000:0.0:1787823598.363862:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+9:10277:x1874668629813888:12345-192.168.202.35@tcp:101:lctl.0 00010000:00010000:0.0:1787823598.363889:0:7893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823598.363913:0:7893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b8324819d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f446fc expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.364004:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e400/0x5d1142b8324819db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.364023:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e400/0x5d1142b8324819db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.364039:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e400/0x5d1142b8324819db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787823598.364117:0:7893:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787823598.364123:0:7893:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787823598.364297:0:7893:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e400/0x5d1142b8324819db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.364324:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b8324819d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446fc expref: 11 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.364367:0:7893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e400/0x5d1142b8324819db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446fc expref: 10 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.364376:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e791767b600) 00010000:00010000:0.0:1787823598.364379:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787823598.364383:0:7893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40e400, rc 0) 00000100:00100000:0.0:1787823598.364452:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+10:10277:x1874668629813888:12345-192.168.202.35@tcp:101:lctl.0 Request processed in 593us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823598.364461:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 38 00000100:00100000:3.0:1787823598.440152:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823598.440297:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629814016 00000100:00100000:0.0:1787823598.440307:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629814016 00000100:00100000:0.0:1787823598.440369:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 39 00000100:00100000:0.0:1787823598.440379:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922b8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+10:10283:x1874668629814016:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:0.0:1787823598.440406:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823598.440437:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b8324819e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44703 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.440546:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e200/0x5d1142b8324819e9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.440564:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e200/0x5d1142b8324819e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.440577:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e200/0x5d1142b8324819e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.440591:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b8324819f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.440614:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b8324819f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.440621:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b8324819f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.440812:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fc00/0x5d1142b8324819f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.440822:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fc00/0x5d1142b8324819f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.440828:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fc00/0x5d1142b8324819f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787823598.440866:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1787823598.440870:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787823598.441196:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fc00/0x5d1142b8324819f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.441209:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e200/0x5d1142b8324819e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.441214:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e200/0x5d1142b8324819e9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.441219:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e200/0x5d1142b8324819e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.441222:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40e200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823598.441226:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e200/0x5d1142b8324819e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.441236:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e200/0x5d1142b8324819e9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.441246:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e791767b600) 00010000:00010000:0.0:1787823598.441248:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823598.441252:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e200/0x5d1142b8324819e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.441256:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e200/0x5d1142b8324819e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.441266:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b8324819f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.441270:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b8324819f0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.441274:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b8324819f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.441277:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40f000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823598.441278:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b8324819f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.441281:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b8324819f0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.441285:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8e791767be00) 00010000:00010000:0.0:1787823598.441286:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823598.441288:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b8324819f0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.441297:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b8324819f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.441324:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b8324819e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44703 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.441333:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fc00/0x5d1142b8324819f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44703 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.441338:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e791767b200) 00010000:00010000:0.0:1787823598.441340:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787823598.441341:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40fc00, rc 0) 00000100:00100000:0.0:1787823598.441409:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922b8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+11:10283:x1874668629814016:12345-192.168.202.35@tcp:101:bash.0 Request processed in 1031us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823598.441414:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 39 00000100:00100000:2.0:1787823598.446164:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823598.446231:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629814272 00000100:00100000:0.0:1787823598.446240:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629814272 00000100:00100000:0.0:1787823598.446290:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 40 00000100:00100000:0.0:1787823598.446297:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+11:10283:x1874668629814272:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:0.0:1787823598.446318:0:7893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823598.446338:0:7893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b8324819fe lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f4470a expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.446473:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832481a05 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.446486:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832481a05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.446517:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832481a05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.446571:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f400/0x5d1142b832481a0c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.446580:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f400/0x5d1142b832481a0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.446586:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f400/0x5d1142b832481a0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787823598.447143:0:7893:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1787823598.447282:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481a13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.447290:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481a13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.447295:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481a13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.447323:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832481a05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.447327:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832481a05 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.447332:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832481a05 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.447335:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40e000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823598.447344:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832481a05 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.447349:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832481a05 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.447359:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e791767b200) 00010000:00010000:0.0:1787823598.447361:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823598.447365:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832481a05 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.447371:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832481a05 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787823598.447383:0:7893:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e94c7e8 reply state 00000000331a5110 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f400/0x5d1142b832481a0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823598.447391:0:7893:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787823598.447419:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b8324819fe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4470a expref: 14 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.447430:0:7893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481a13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4470a expref: 13 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.447435:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e791767be00) 00010000:00010000:0.0:1787823598.447437:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787823598.447439:0:7893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40fe00, rc 0) 00000100:00100000:0.0:1787823598.447503:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+14:10283:x1874668629814272:12345-192.168.202.35@tcp:101:bash.0 Request processed in 1206us (1349us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787823598.447511:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 40 00000100:00100000:2.0:1787823598.452088:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00010000:00010000:1.0:1787823598.452192:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f400/0x5d1142b832481a0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823598.452206:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f400/0x5d1142b832481a0c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823598.452214:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f400/0x5d1142b832481a0c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823598.452221:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40f400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823598.452226:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f400/0x5d1142b832481a0c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823598.452235:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f400/0x5d1142b832481a0c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823598.452252:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e791767bb00) 00010000:00010000:1.0:1787823598.452255:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823598.452260:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f400/0x5d1142b832481a0c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823598.452266:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f400/0x5d1142b832481a0c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823598.452369:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629814400 00000100:00100000:3.0:1787823598.452380:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629814400 00000100:00100000:3.0:1787823598.452425:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 20 00000100:00100000:3.0:1787823598.452435:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1874668629814400:12345-192.168.202.35@tcp:8:bash.0 00010000:00080000:3.0:1787823598.452467:0:6686:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from 353832f0-fe7b-4d99-975c-a8041babed42@192.168.202.35@tcp t0 exp 0000000000000000 cur 339 last 0 00000020:00000080:3.0:1787823598.452499:0:6686:0:(genops.c:1385:class_connect()) connect: client 353832f0-fe7b-4d99-975c-a8041babed42, cookie 0x5d1142b832481a21 00002000:00100000:3.0:1787823598.452521:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 353832f0-fe7b-4d99-975c-a8041babed42/ffff8e792054a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787823598.452547:0:6686:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787823598.452861:0:6686:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787823598.452893:0:6686:0:(import.c:65:import_set_state_nolock()) ffff8e792054d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787823598.452957:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+6:2351:x1874668629814400:12345-192.168.202.35@tcp:8:bash.0 Request processed in 522us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823598.452966:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 20 00000100:00100000:3.0:1787823598.456449:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823598.456554:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629814528 00000100:00100000:1.0:1787823598.456565:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629814528 00000100:00100000:1.0:1787823598.456648:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 21 00000100:00100000:1.0:1787823598.456659:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a49cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+6:0:x1874668629814528:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:1.0:1787823598.456679:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823598.456704:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095f48212/0x5d1142b832481a28 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44711 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787823598.456742:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787823598.456813:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=339s v=(0 0) 00010000:00010000:1.0:1787823598.456819:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787823598.456829:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095f48212/0x5d1142b832481a28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44711 expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823598.456851:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000095f48212/0x5d1142b832481a28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44711 expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823598.456877:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a2f2a00, rc 0) 00000100:00100000:1.0:1787823598.456947:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a49cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+7:0:x1874668629814528:12345-192.168.202.35@tcp:101:bash.0 Request processed in 289us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823598.456953:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 21 00000100:00080000:3.0:1787823598.457738:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787823598.464919:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823598.465075:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629814656 00000100:00100000:1.0:1787823598.465086:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629814656 00000100:00100000:1.0:1787823598.465148:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 22 00000100:00100000:1.0:1787823598.465158:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:353832f0-fe7b-4d99-975c-a8041babed42+7:10283:x1874668629814656:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:1.0:1787823598.465194:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823598.465213:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b596990f/0x5d1142b832481a2f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44718 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823598.465245:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000095f48212/0x5d1142b832481a28 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44711 expref: 8 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823598.465254:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787823598.465259:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787823598.465264:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b596990f/0x5d1142b832481a2f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44718 expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823598.465297:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000095f48212/0x5d1142b832481a28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44711 expref: 8 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823598.465311:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000095f48212/0x5d1142b832481a28 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44711 expref: 8 pid: 6687 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823598.465326:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4ca1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6688:1874668651871104:192.168.202.35@tcp:104: 00000100:00100000:1.0:1787823598.465434:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a47a480 going to sleep for 11 seconds 00000100:00100000:0.0:1787823598.469075:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823598.469220:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629814784 00000100:00100000:2.0:1787823598.469230:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629814784 00010000:00010000:2.0:1787823598.469295:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000095f48212/0x5d1142b832481a28 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44711 expref: 9 pid: 6687 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823598.469339:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 35 00000100:00100000:2.0:1787823598.469349:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e809680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:353832f0-fe7b-4d99-975c-a8041babed42+9:2352:x1874668629814784:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787823598.469364:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787823598.469390:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000095f48212/0x5d1142b832481a28 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44711 expref: 9 pid: 6687 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.469404:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000095f48212/0x5d1142b832481a28 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44711 expref: 9 pid: 6687 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.469435:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823598.469440:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823598.469449:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b596990f/0x5d1142b832481a2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44718 expref: 9 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.469459:0:8457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b596990f/0x5d1142b832481a2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44718 expref: 9 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.469517:0:8457:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b596990f/0x5d1142b832481a2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44718 expref: 9 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823598.469535:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0de00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8457:1874668651871232:192.168.202.35@tcp:105: 00000100:00100000:2.0:1787823598.469649:0:8457:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e791a680d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787823598.472446:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0de00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8457:1874668651871232:192.168.202.35@tcp:105: 00010000:00010000:2.0:1787823598.472505:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787823598.472569:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e809680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:353832f0-fe7b-4d99-975c-a8041babed42+9:2352:x1874668629814784:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 3220us (3504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823598.472580:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 35 00010000:00010000:1.0:1787823598.474416:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095f48212/0x5d1142b832481a28 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44711 expref: 8 pid: 6687 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823598.474441:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4ca1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6688:1874668651871104:192.168.202.35@tcp:104: 00010000:00010000:1.0:1787823598.474473:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b596990f/0x5d1142b832481a2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44718 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823598.474519:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a2f3600, rc 0) 00000100:00100000:1.0:1787823598.474578:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:353832f0-fe7b-4d99-975c-a8041babed42+7:10283:x1874668629814656:12345-192.168.202.35@tcp:101:bash.0 Request processed in 9421us (9669us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823598.474586:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 22 00000100:00100000:3.0:1787823598.482181:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823598.482459:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629815040 00000100:00100000:2.0:1787823598.482473:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629815040 00000100:00100000:2.0:1787823598.482554:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 6 00000100:00100000:2.0:1787823598.482565:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a49da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+13:10283:x1874668629815040:12345-192.168.202.35@tcp:35:bash.0 00000001:00080000:2.0:1787823598.483344:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967312 00000100:00100000:2.0:1787823598.483481:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a49da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+15:10283:x1874668629815040:12345-192.168.202.35@tcp:35:bash.0 Request processed in 915us (1311us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1787823598.483714:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 6 00000020:00080000:2.0:1787823598.483719:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787823598.580005:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823598.580044:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629815296 00000100:00100000:3.0:1787823598.580056:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629815296 00000100:00100000:3.0:1787823598.580114:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 41 00000100:00100000:3.0:1787823598.580125:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939dc1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+15:10293:x1874668629815296:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:3.0:1787823598.580155:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823598.580177:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481a36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f4471f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787823598.580430:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1787823598.580669:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481a36 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4471f expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.580688:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e791767b600) 00010000:00010000:3.0:1787823598.580691:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787823598.580699:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481a36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4471f expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.580716:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7920eea600, rc 0) 00000100:00100000:3.0:1787823598.580829:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939dc1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+16:10293:x1874668629815296:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 705us (832us total) trans 4294967314 rc 301/301 00000100:00100000:3.0:1787823598.580837:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 41 00000100:00100000:0.0:1787823598.585075:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823598.586675:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629815552 00000100:00100000:3.0:1787823598.586690:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629815552 00000100:00100000:3.0:1787823598.586794:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 7 00000100:00100000:3.0:1787823598.586807:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e808780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+16:10293:x1874668629815552:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:3.0:1787823598.588009:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e808780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+17:10293:x1874668629815552:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 1196us (2932us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1787823598.588020:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 7 00000001:00100000:1.0:1787823598.664899:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 353832f0-fe7b-4d99-975c-a8041babed42 00000100:00100000:3.0:1787823598.671630:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823598.673735:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629815680 00000100:00100000:1.0:1787823598.673750:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629815680 00000100:00100000:1.0:1787823598.674317:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 42 00000100:00100000:1.0:1787823598.674328:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939dc2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+17:10299:x1874668629815680:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:1.0:1787823598.674352:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823598.674374:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481a44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44726 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823598.674443:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481a4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823598.674458:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481a4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823598.674470:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481a4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787823598.674731:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1787823598.674735:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787823598.675290:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481a4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823598.675325:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481a44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44726 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823598.675353:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481a4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44726 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823598.675361:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e791767b200) 00010000:00010000:1.0:1787823598.675364:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787823598.675367:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a2f2200, rc 0) 00000100:00100000:1.0:1787823598.675434:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939dc2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+18:10299:x1874668629815680:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 1107us (3815us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823598.675441:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 42 00000001:00080000:0.0:1787823598.682978:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967311 is committed 00000001:00080000:0.0:1787823598.682998:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967313 is committed 00000100:00100000:0.0:1787823598.691384:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823598.691936:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629815936 00000100:00100000:3.0:1787823598.691946:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629815936 00000100:00100000:3.0:1787823598.692002:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 43 00000100:00100000:3.0:1787823598.692013:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+13:10299:x1874668629815936:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:3.0:1787823598.692049:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823598.692072:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481a52 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f4472d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.692657:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481a59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.692678:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481a59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.692690:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481a59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787823598.692701:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787823598.693861:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481a52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4472d expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.693891:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481a59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4472d expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.693901:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e791767be00) 00010000:00010000:3.0:1787823598.693904:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787823598.693908:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7920eebc00, rc 0) 00000100:00100000:3.0:1787823598.693987:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+15:10299:x1874668629815936:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 1974us (2614us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787823598.693996:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 43 00000100:00100000:1.0:1787823598.703035:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823598.703085:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823598.703180:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629816192 00000100:00100000:0.0:1787823598.703190:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629816192 00000100:00100000:0.0:1787823598.703251:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 44 00000100:00100000:0.0:1787823598.703261:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+15:10299:x1874668629816192:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787823598.703286:0:7893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823598.703307:0:7893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481a67 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44734 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.703405:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832481a6e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.703420:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832481a6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.703431:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832481a6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787823598.703443:0:7893:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787823598.703577:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481a67 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44734 expref: 18 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.703595:0:7893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832481a6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44734 expref: 17 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.703604:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e791767be00) 00010000:00010000:0.0:1787823598.703620:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787823598.703624:0:7893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40f600, rc 0) 00000100:00100000:0.0:1787823598.703694:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+17:10299:x1874668629816192:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 434us (668us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1787823598.703700:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 44 00000100:00100000:3.0:1787823598.712223:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629816320 00000100:00100000:3.0:1787823598.712240:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629816320 00000100:00100000:3.0:1787823598.712328:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 2 00000100:00100000:3.0:1787823598.712352:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4c9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:353832f0-fe7b-4d99-975c-a8041babed42+17:2352:x1874668629816320:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787823598.712368:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787823598.712396:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481a59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4472d expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.712416:0:7631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e791767be00) 00010000:00010000:3.0:1787823598.712421:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787823598.712500:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4c9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:353832f0-fe7b-4d99-975c-a8041babed42+16:2352:x1874668629816320:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 149us (9412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823598.712509:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 2 00000100:00100000:1.0:1787823598.713963:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823598.714050:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629816448 00000100:00100000:2.0:1787823598.714058:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629816448 00000100:00100000:2.0:1787823598.714112:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 23 00000100:00100000:2.0:1787823598.714122:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4cad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+6:2353:x1874668629816448:12345-192.168.202.35@tcp:1:lfs.0 00010000:00010000:2.0:1787823598.714175:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032570d00/0x5d1142b832481a7c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.714195:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b596990f/0x5d1142b832481a2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44718 expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.714203:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823598.714207:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787823598.714212:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032570d00/0x5d1142b832481a7c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.714259:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b596990f/0x5d1142b832481a2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44718 expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.714272:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b596990f/0x5d1142b832481a2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44718 expref: 6 pid: 6688 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823598.714287:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0de00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6686:1874668651871360:192.168.202.35@tcp:104: 00000100:00100000:2.0:1787823598.714371:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a47a780 going to sleep for 11 seconds 00000100:00100000:3.0:1787823598.718469:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0de00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6686:1874668651871360:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787823598.718507:0:6686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000032570d00/0x5d1142b832481a7c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823598.723509:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823598.723592:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629816576 00000100:00100000:3.0:1787823598.723605:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629816576 00002000:00100000:3.0:1787823598.723665:0:6691:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8e7922a0fc00 x1874668629816576/t0(0) o4->353832f0-fe7b-4d99-975c-a8041babed42@192.168.202.35@tcp:219/0 lens 504/0 e 0 to 0 dl 1787823609 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787823598.723677:0:6691:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8e7922a0fc00 with x1874668629816576 ext(0->12) 00010000:00010000:3.0:1787823598.723688:0:6691:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b596990f/0x5d1142b832481a2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44718 expref: 7 pid: 6688 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.723705:0:6691:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b596990f/0x5d1142b832481a2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44718 expref: 7 pid: 6688 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787823598.723713:0:6691:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e7922a0fc00 00000100:00100000:3.0:1787823598.723808:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 0 00000100:00100000:3.0:1787823598.723819:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:353832f0-fe7b-4d99-975c-a8041babed42+7:2352:x1874668629816576:12345-192.168.202.35@tcp:4:lfs.0 00000100:00100000:1.0:1787823598.724751:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:353832f0-fe7b-4d99-975c-a8041babed42+9:2352:x1874668629816576:12345-192.168.202.35@tcp:4:lfs.0 Request processed in 929us (5600us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787823598.724801:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 0 00002000:00100000:1.0:1787823598.724810:0:6691:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8e7922a0fc00 x1874668629816576/t4294967299(0) o4->353832f0-fe7b-4d99-975c-a8041babed42@192.168.202.35@tcp:219/0 lens 504/448 e 0 to 0 dl 1787823609 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787823598.724819:0:6691:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8e7922a0fc00 with x1874668629816576 ext(0->12) 00010000:00010000:1.0:1787823598.724826:0:6691:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b596990f/0x5d1142b832481a2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44718 expref: 9 pid: 6688 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823598.724841:0:6691:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b596990f/0x5d1142b832481a2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44718 expref: 9 pid: 6688 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787823598.724848:0:6691:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e7922a0fc00 00000100:00100000:0.0:1787823598.740019:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823598.740104:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629816704 00000100:00100000:2.0:1787823598.740113:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629816704 00010000:00010000:2.0:1787823598.740169:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b596990f/0x5d1142b832481a2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44718 expref: 9 pid: 6688 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823598.740212:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 36 00000100:00100000:2.0:1787823598.740222:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:353832f0-fe7b-4d99-975c-a8041babed42+9:2355:x1874668629816704:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787823598.740238:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787823598.740258:0:5825:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787823598.740262:0:5825:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787823599 00002000:00010000:2.0:1787823598.740264:0:5825:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787823599 00002000:00010000:2.0:1787823598.740266:0:5825:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787823599 00010000:00010000:2.0:1787823598.740273:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b596990f/0x5d1142b832481a2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44718 expref: 9 pid: 6688 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.740309:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b596990f/0x5d1142b832481a2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44718 expref: 9 pid: 6688 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.740334:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b596990f/0x5d1142b832481a2f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44718 expref: 9 pid: 6688 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.740349:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787823598.740353:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787823598.740472:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000032570d00/0x5d1142b832481a7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.740485:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032570d00/0x5d1142b832481a7c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.740522:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787823598.740647:0:6686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000032570d00/0x5d1142b832481a7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.740656:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032570d00/0x5d1142b832481a7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.740678:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032570d00/0x5d1142b832481a7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.740685:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032570d00/0x5d1142b832481a7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.740693:0:6686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032570d00/0x5d1142b832481a7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.740700:0:6686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3a00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:0.0:1787823598.740705:0:6686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032570d00/0x5d1142b832481a7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.740713:0:6686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032570d00/0x5d1142b832481a7c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.740740:0:6686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032570d00/0x5d1142b832481a7c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.740748:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032570d00/0x5d1142b832481a7c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823598.740905:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:353832f0-fe7b-4d99-975c-a8041babed42+8:2355:x1874668629816704:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 683us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823598.740914:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 36 00000100:00100000:0.0:1787823598.742967:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4cad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+7:2353:x1874668629816448:12345-192.168.202.35@tcp:1:lfs.0 Request processed in 28835us (29000us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823598.742981:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 23 00000100:00100000:0.0:1787823598.754146:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823598.754306:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629816960 00000100:00100000:3.0:1787823598.754317:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629816960 00000100:00100000:3.0:1787823598.754393:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 8 00000100:00100000:3.0:1787823598.754404:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+16:10299:x1874668629816960:12345-192.168.202.35@tcp:35:lfs.0 00000004:00010000:3.0:1787823598.754467:0:5841:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832481a6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44734 expref: 16 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787823598.755309:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1787823598.755382:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1787823598.756123:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00010000:00010000:2.0:1787823598.756374:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481a83 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.756395:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481a13 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4470a expref: 20 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.756415:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481a83 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.756453:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481a13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4470a expref: 20 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.756471:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481a13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4470a expref: 20 pid: 7893 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823598.756486:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0f840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5841:1874668651871488:192.168.202.35@tcp:104: 00000100:00100000:2.0:1787823598.756812:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a47a840 going to sleep for 11 seconds 00000100:00100000:2.0:1787823598.767524:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823598.767829:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0f840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5841:1874668651871488:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787823598.767857:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481a83 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823598.768250:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629817088 00000100:00100000:0.0:1787823598.768258:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629817088 00010000:00010000:0.0:1787823598.768297:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481a13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4470a expref: 21 pid: 7893 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823598.768339:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 37 00000100:00100000:0.0:1787823598.768350:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:353832f0-fe7b-4d99-975c-a8041babed42+21:2353:x1874668629817088:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787823598.768373:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787823598.768380:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481a13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4470a expref: 21 pid: 7893 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.768392:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481a13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4470a expref: 21 pid: 7893 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.768414:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481a13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4470a expref: 21 pid: 7893 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.768442:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e791767be00) 00010000:00010000:0.0:1787823598.768447:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481a83 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.768455:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481a83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.768463:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481a83 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.768493:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787823598.768912:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:353832f0-fe7b-4d99-975c-a8041babed42+20:2353:x1874668629817088:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 562us (1396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823598.768921:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 37 00010000:00010000:2.0:1787823598.769241:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481a83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.769250:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481a83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787823598.769410:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000001:00080000:2.0:1787823598.769886:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1787823598.770014:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0da40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5841:1874668651871616:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787823598.770070:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823598.770162:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a47a840 going to sleep for 11 seconds 00000100:00100000:1.0:1787823598.776497:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651871616 00000100:00100000:1.0:1787823598.776514:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651871616 00000100:00100000:1.0:1787823598.776749:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787823598.776817:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1874668651871616:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787823598.776946:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1874668651871616:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 189us (6876us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823598.776954:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787823598.777195:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0da40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5841:1874668651871616:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787823598.777960:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1787823598.778053:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0da40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5841:1874668651871744:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787823598.778114:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823598.778137:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a47aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787823598.778661:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651871744 00000100:00100000:1.0:1787823598.778668:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651871744 00000100:00100000:1.0:1787823598.778718:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787823598.778727:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1874668651871744:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787823598.778949:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1874668651871744:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 223us (834us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787823598.778958:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787823598.779215:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0da40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5841:1874668651871744:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787823598.779278:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1787823598.779319:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481a83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.779329:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481a83 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.779337:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481a83 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.779343:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823598.779347:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481a83 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.779355:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481a83 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.779644:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e791767be00) 00010000:00010000:2.0:1787823598.779648:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787823598.779655:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481a83 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823598.779662:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481a83 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787823598.781974:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787823598.783477:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1787823598.783503:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 339637742767ns, next at 340637737309ns, rc = 0 00000001:00080000:2.0:1787823598.783536:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1787823598.783689:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e791767be00) 00010000:00010000:2.0:1787823598.783694:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787823598.783705:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832481a6e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44734 expref: 24 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787823598.784499:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787823598.785029:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+23:10299:x1874668629816960:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 30621us (30887us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1787823598.785042:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 8 00000020:00080000:2.0:1787823598.785048:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787823598.813282:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823598.813462:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629817216 00000100:00100000:0.0:1787823598.813472:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629817216 00000100:00100000:0.0:1787823598.813530:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 45 00000100:00100000:0.0:1787823598.813541:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+23:10299:x1874668629817216:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787823598.813629:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823598.813653:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481a8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f4473b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.813709:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481a8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4473b expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.813722:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481a8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4473b expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.813750:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e791767b300) 00010000:00010000:0.0:1787823598.813754:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787823598.813996:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40e600, rc 0) 00000100:00100000:0.0:1787823598.814053:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+24:10299:x1874668629817216:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 514us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823598.814060:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 45 00000100:00100000:0.0:1787823598.822453:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00010000:00010000:0.0:1787823598.826150:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787823598.826224:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629817472 00000100:00100000:2.0:1787823598.826236:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629817472 00000100:00100000:2.0:1787823598.826309:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00100000:2.0:1787823598.826320:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7925a93450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+24:10299:x1874668629817472:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:2.0:1787823598.827697:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7925a93450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+25:10299:x1874668629817472:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 1371us (5247us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1787823598.827710:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00100000:1.0:1787823598.931896:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823598.932190:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629817728 00000100:00100000:0.0:1787823598.932199:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629817728 00000100:00100000:0.0:1787823598.932303:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 46 00000100:00100000:0.0:1787823598.932326:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+25:10309:x1874668629817728:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787823598.932366:0:7893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823598.932392:0:7893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832481a91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44742 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787823598.932749:0:7893:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787823598.933077:0:7893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832481a91 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44742 expref: 27 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.933098:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e791767b600) 00010000:00010000:0.0:1787823598.933101:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787823598.933107:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832481a91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44742 expref: 27 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823598.933121:0:7893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40f600, rc 0) 00000100:00100000:0.0:1787823598.933194:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+26:10309:x1874668629817728:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 881us (1308us total) trans 4294967328 rc 301/301 00000100:00100000:0.0:1787823598.933202:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 46 00000100:00100000:1.0:1787823598.947999:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823598.948697:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629817856 00000100:00100000:3.0:1787823598.948709:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629817856 00000100:00100000:3.0:1787823598.949071:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 47 00000100:00100000:3.0:1787823598.949084:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+26:10309:x1874668629817856:12345-192.168.202.35@tcp:34:lfs.0 00010000:00010000:3.0:1787823598.949174:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481a9f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.949192:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481a9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.949204:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481a9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.949221:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481aa6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.949245:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.949252:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.950141:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b832481aad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.950159:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b832481aad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.950167:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b832481aad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787823598.950219:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b832481aad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.950232:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481a9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.950238:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481a9f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.950245:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481a9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.950252:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eebc00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823598.950256:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481a9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.950264:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481a9f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.950286:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e791767b200) 00010000:00010000:3.0:1787823598.950290:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787823598.950296:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481a9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.950303:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481a9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.950337:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.950344:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481aa6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.950351:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481aa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.950356:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eea600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823598.950628:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481aa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.950638:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481aa6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.950648:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e79087c9300) 00010000:00010000:3.0:1787823598.950651:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787823598.950654:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481aa6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.950661:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481aa6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.950690:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b832481aad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.950697:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b832481aad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.950703:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b832481aad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.950708:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eea400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823598.950712:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b832481aad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.950719:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b832481aad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.950961:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e791767b300) 00010000:00010000:3.0:1787823598.950966:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787823598.950971:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b832481aad lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823598.950978:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b832481aad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823598.951090:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+26:10309:x1874668629817856:12345-192.168.202.35@tcp:34:lfs.0 Request processed in 2003us (3098us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823598.951103:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 47 00000100:00100000:2.0:1787823598.960823:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823598.961027:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629818112 00000100:00100000:3.0:1787823598.961040:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629818112 00000100:00100000:3.0:1787823598.961113:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 10 00000100:00100000:3.0:1787823598.961146:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+26:10309:x1874668629818112:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:3.0:1787823598.962164:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+27:10309:x1874668629818112:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 1016us (1398us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1787823598.962176:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 10 00000100:00100000:0.0:1787823599.014330:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823599.014512:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629818368 00000100:00100000:1.0:1787823599.014525:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629818368 00000100:00100000:1.0:1787823599.014595:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 48 00000100:00100000:1.0:1787823599.014605:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+27:10312:x1874668629818368:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:1.0:1787823599.014636:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823599.014658:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b832481ab4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44749 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823599.014813:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481abb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823599.014849:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481abb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823599.014862:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481abb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823599.014879:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481ac2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823599.014886:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823599.014894:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823599.015247:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481ac9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823599.015257:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823599.015265:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787823599.015275:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787823599.016672:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481abb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823599.016688:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481abb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823599.016697:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481abb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823599.016737:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f3a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823599.016742:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481abb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823599.016782:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481abb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823599.016800:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e791767b200) 00010000:00010000:1.0:1787823599.016803:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823599.016807:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481abb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823599.016814:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481abb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823599.016830:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823599.016836:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481ac2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823599.016842:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823599.016848:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f2a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823599.016851:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823599.016857:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481ac2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823599.016877:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e7917859500) 00010000:00010000:1.0:1787823599.016880:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823599.016884:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481ac2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823599.016890:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481ac2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823599.016961:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b832481ab4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44749 expref: 30 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823599.016977:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481ac9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44749 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823599.016986:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e791767b300) 00010000:00010000:1.0:1787823599.016988:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787823599.016991:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a2f3600, rc 0) 00000100:00100000:1.0:1787823599.017084:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+29:10312:x1874668629818368:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 2478us (2762us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1787823599.017094:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 48 00000100:00100000:1.0:1787823599.023734:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823599.024088:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629818496 00000100:00100000:0.0:1787823599.024098:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629818496 00000100:00100000:0.0:1787823599.024172:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 49 00000100:00100000:0.0:1787823599.024182:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+29:10312:x1874668629818496:12345-192.168.202.35@tcp:54:lfs.0 00010000:00010000:0.0:1787823599.024525:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481ad7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823599.024543:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823599.024556:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823599.024582:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823599.024588:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481ad7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823599.024595:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481ad7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823599.024601:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40fe00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823599.024605:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481ad7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823599.024613:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481ad7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823599.024639:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e791767b300) 00010000:00010000:0.0:1787823599.024642:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787823599.024647:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481ad7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823599.024654:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481ad7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823599.024728:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+29:10312:x1874668629818496:12345-192.168.202.35@tcp:54:lfs.0 Request processed in 547us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823599.024736:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 49 00000100:00100000:2.0:1787823599.027167:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823599.027245:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629818752 00000100:00100000:0.0:1787823599.027255:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629818752 00000100:00100000:0.0:1787823599.027326:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 11 00000100:00100000:0.0:1787823599.027337:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+29:10312:x1874668629818752:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:0.0:1787823599.027593:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+30:10312:x1874668629818752:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 256us (434us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1787823599.027601:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 11 00000100:00100000:3.0:1787823599.082147:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787823599.083127:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792e80a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651871872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787823599.083207:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823599.083376:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651871872 00000100:00100000:2.0:1787823599.083384:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651871872 00000100:00100000:2.0:1787823599.083432:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787823599.083442:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874668651871872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787823599.083464:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787823599.083514:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874668651871872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823599.083521:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787823599.084054:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792e80a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651871872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787823599.482883:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823599.483178:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629819008 00000100:00100000:0.0:1787823599.483189:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629819008 00000100:00100000:0.0:1787823599.483367:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 50 00000100:00100000:0.0:1787823599.483379:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+30:10343:x1874668629819008:12345-192.168.202.35@tcp:101:cat.0 00010000:00010000:0.0:1787823599.483403:0:7893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823599.483426:0:7893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481ade lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44750 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823599.483523:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832481ae5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823599.483552:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832481ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823599.483566:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832481ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787823599.483577:0:7893:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787823599.483713:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481ade lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44750 expref: 33 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823599.483746:0:7893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832481ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44750 expref: 32 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823599.483755:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e791767b300) 00010000:00010000:0.0:1787823599.483816:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787823599.483821:0:7893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40ec00, rc 0) 00000100:00100000:0.0:1787823599.484684:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+32:10343:x1874668629819008:12345-192.168.202.35@tcp:101:cat.0 Request processed in 533us (1040us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1787823599.484695:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 50 00000100:00100000:1.0:1787823599.490464:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823599.490756:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823599.491486:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629819136 00000100:00100000:0.0:1787823599.491507:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629819136 00000100:00100000:0.0:1787823599.491580:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 3 00000100:00100000:0.0:1787823599.491592:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909a21850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:353832f0-fe7b-4d99-975c-a8041babed42+32:2352:x1874668629819136:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787823599.491608:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787823599.491632:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832481ae5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44750 expref: 32 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823599.491668:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e791767b300) 00010000:00010000:0.0:1787823599.491673:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787823599.491743:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909a21850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:353832f0-fe7b-4d99-975c-a8041babed42+31:2352:x1874668629819136:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 154us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823599.491751:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 3 00000100:00100000:3.0:1787823599.492675:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629819392 00000100:00100000:3.0:1787823599.492685:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629819392 00000100:00100000:3.0:1787823599.492800:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 12 00000100:00100000:3.0:1787823599.492809:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+31:10343:x1874668629819392:12345-192.168.202.35@tcp:35:cat.0 00000100:00100000:3.0:1787823599.493101:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+32:10343:x1874668629819392:12345-192.168.202.35@tcp:35:cat.0 Request processed in 292us (2345us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1787823599.493108:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 12 00000100:00100000:3.0:1787823599.647298:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823599.647489:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629819648 00000100:00100000:2.0:1787823599.647504:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629819648 00000100:00100000:2.0:1787823599.647584:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 51 00000100:00100000:2.0:1787823599.647595:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+32:10349:x1874668629819648:12345-192.168.202.35@tcp:101:dd.0 00010000:00010000:2.0:1787823599.647630:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823599.647634:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787823599.647666:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481a4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44726 expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823599.647687:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e791767b200) 00010000:00010000:2.0:1787823599.647693:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787823599.647710:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832481af3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44757 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823599.647899:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481afa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823599.647927:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481ac9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44749 expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823599.647935:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481afa lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823599.647970:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481ac9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44749 expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823599.647982:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481ac9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44749 expref: 32 pid: 5840 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823599.648018:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1874668651872000:192.168.202.35@tcp:104: 00000100:00100000:2.0:1787823599.648116:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e791ad57f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787823599.653740:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823599.654440:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1874668651872000:192.168.202.35@tcp:104: 00010000:00010000:2.0:1787823599.654471:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481afa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823599.655512:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629819776 00000100:00100000:3.0:1787823599.655525:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629819776 00010000:00010000:3.0:1787823599.655571:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481ac9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44749 expref: 33 pid: 5840 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823599.655616:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 38 00000100:00100000:3.0:1787823599.655627:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0efc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:353832f0-fe7b-4d99-975c-a8041babed42+33:2353:x1874668629819776:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787823599.655645:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787823599.655654:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481ac9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44749 expref: 33 pid: 5840 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823599.655684:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481ac9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44749 expref: 33 pid: 5840 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823599.655710:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481ac9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44749 expref: 33 pid: 5840 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823599.655750:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e791767b300) 00010000:00010000:3.0:1787823599.655816:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481afa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823599.655829:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481afa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823599.655838:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481afa lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823599.656185:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787823599.656261:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0efc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:353832f0-fe7b-4d99-975c-a8041babed42+32:2353:x1874668629819776:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 634us (2547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823599.656270:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 38 00010000:00010000:2.0:1787823599.656949:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481afa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823599.656965:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481afa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787823599.656989:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787823599.657201:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832481af3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44757 expref: 33 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823599.657221:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481afa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44757 expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823599.657229:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e791767b300) 00010000:00010000:2.0:1787823599.657232:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787823599.657235:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d2c00, rc 0) 00000100:00100000:2.0:1787823599.657275:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+32:10349:x1874668629819648:12345-192.168.202.35@tcp:101:dd.0 Request processed in 9682us (9990us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1787823599.657283:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 51 00000100:00100000:3.0:1787823599.662241:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823599.669078:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629820032 00000100:00100000:1.0:1787823599.669097:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629820032 00000100:00100000:1.0:1787823599.669195:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 52 00000100:00100000:1.0:1787823599.669207:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+32:10349:x1874668629820032:12345-192.168.202.35@tcp:36:dd.0 00010000:00010000:1.0:1787823599.670000:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481b08 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823599.670021:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481b08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823599.670033:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481b08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787823599.670096:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967335 00000004:00010000:1.0:1787823599.670122:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b420b53 reply state 0000000036d47961 transno 4294967336 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481b08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823599.670132:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787823599.670292:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+35:10349:x1874668629820032:12345-192.168.202.35@tcp:36:dd.0 Request processed in 1084us (8058us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1787823599.670301:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 52 00000020:00080000:1.0:1787823599.670316:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787823599.682616:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481b08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823599.682639:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481b08 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823599.682647:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481b08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823599.682677:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f3a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823599.682683:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481b08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823599.682691:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481b08 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823599.682712:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e791767b300) 00010000:00010000:3.0:1787823599.682731:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787823599.682737:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481b08 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823599.682744:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481b08 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823599.850055:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823600.152985:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823600.153106:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629820160 00000100:00100000:0.0:1787823600.153117:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629820160 00000100:00100000:0.0:1787823600.153206:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 53 00000100:00100000:0.0:1787823600.153219:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+34:10363:x1874668629820160:12345-192.168.202.35@tcp:101:stat.0 00010000:00010000:0.0:1787823600.153243:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823600.153264:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832481b0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f4475e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.153344:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481b16 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.153358:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481b16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.153373:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481b16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.153388:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b832481b1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.153412:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b832481b1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.153449:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b832481b1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.153841:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832481b24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.153853:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481afa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44757 expref: 35 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.153863:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832481b24 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.153903:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481afa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44757 expref: 35 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.153917:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481afa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44757 expref: 35 pid: 5838 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787823600.153964:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787823600.154007:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792e809680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1874668651872128:192.168.202.35@tcp:104: 00000100:00100000:0.0:1787823600.154223:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908a3ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787823600.160545:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823600.161701:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629820416 00000100:00100000:3.0:1787823600.161715:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629820416 00000100:00100000:3.0:1787823600.161928:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 13 00000100:00100000:3.0:1787823600.161943:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+36:5592:x1874668629820416:12345-192.168.202.35@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787823600.162336:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+37:5592:x1874668629820416:12345-192.168.202.35@tcp:35:ldlm_bl.0 Request processed in 394us (1799us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1787823600.162345:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 13 00000100:00100000:3.0:1787823600.165233:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823600.165365:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629820544 00000100:00100000:1.0:1787823600.165374:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629820544 00010000:00010000:1.0:1787823600.165423:0:7631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481afa lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44757 expref: 37 pid: 5838 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823600.165469:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 39 00000100:00100000:1.0:1787823600.165481:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:353832f0-fe7b-4d99-975c-a8041babed42+37:2352:x1874668629820544:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787823600.165506:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823600.165513:0:7631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481afa lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44757 expref: 37 pid: 5838 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.165535:0:7631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481afa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44757 expref: 37 pid: 5838 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.165562:0:7631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e791767b300) 00010000:00010000:1.0:1787823600.165568:0:7631:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832481b24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.165578:0:7631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832481b24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.165586:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832481b24 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.165606:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823600.165666:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:353832f0-fe7b-4d99-975c-a8041babed42+37:2352:x1874668629820544:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 186us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823600.165674:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 39 00010000:00010000:0.0:1787823600.168266:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481afa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44757 expref: 36 pid: 5838 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823600.168345:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792e809680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1874668651872128:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787823600.171217:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832481b24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.171235:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832481b24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.171263:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832481b24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787823600.171327:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787823600.171332:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787823600.171388:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832481b24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.171412:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832481b24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.171424:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481b16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.171431:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481b16 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.171439:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481b16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.171444:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40fe00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823600.171448:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481b16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.171456:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481b16 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.171472:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e791767b200) 00010000:00010000:0.0:1787823600.171475:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823600.171479:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481b16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.171511:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481b16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.171530:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b832481b1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.171537:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b832481b1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.171543:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b832481b1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.171548:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40ea00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823600.171552:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b832481b1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.171558:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b832481b1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.171566:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e791767b000) 00010000:00010000:0.0:1787823600.171569:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823600.171572:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b832481b1d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.171578:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b832481b1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.171623:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832481b0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4475e expref: 36 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.171636:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832481b24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4475e expref: 35 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.171651:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e791767b300) 00010000:00010000:0.0:1787823600.171653:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787823600.171656:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40fa00, rc 0) 00000100:00100000:0.0:1787823600.171744:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+35:10363:x1874668629820160:12345-192.168.202.35@tcp:101:stat.0 Request processed in 18527us (18768us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823600.171753:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 53 00000100:00100000:3.0:1787823600.279417:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823600.281210:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629820800 00000100:00100000:0.0:1787823600.281226:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629820800 00000100:00100000:0.0:1787823600.281328:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 54 00000100:00100000:0.0:1787823600.281341:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+35:10369:x1874668629820800:12345-192.168.202.35@tcp:36:truncate.0 00010000:00010000:0.0:1787823600.281532:0:7893:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787823600.281568:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832481b24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4475e expref: 35 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.281593:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e791767b300) 00010000:00010000:0.0:1787823600.281598:0:7893:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787823600.285345:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832481b2b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.285371:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832481b2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.285384:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832481b2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787823600.285477:0:7893:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967338 00000004:00010000:0.0:1787823600.285511:0:7893:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000040cb8a27 reply state 000000008733fa19 transno 4294967339 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832481b2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823600.285535:0:7893:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787823600.288377:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+37:10369:x1874668629820800:12345-192.168.202.35@tcp:36:truncate.0 Request processed in 7025us (9025us total) trans 4294967339 rc 0/0 00000100:00100000:0.0:1787823600.288392:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 54 00000020:00080000:0.0:1787823600.288399:0:7893:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787823600.296262:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832481b2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823600.296295:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832481b2b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823600.296303:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832481b2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823600.296309:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40ec00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823600.296314:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832481b2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823600.296321:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832481b2b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823600.296340:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e791767b300) 00010000:00010000:3.0:1787823600.296354:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787823600.296359:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832481b2b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823600.296365:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832481b2b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787823600.303319:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787823600.329461:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823600.329509:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823600.329547:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823600.329700:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629821056 00000100:00100000:1.0:1787823600.329711:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629821056 00000100:00100000:1.0:1787823600.329810:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 75 00000100:00100000:1.0:1787823600.329822:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:353832f0-fe7b-4d99-975c-a8041babed42+7:2352:x1874668629821056:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787823600.329898:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:353832f0-fe7b-4d99-975c-a8041babed42+7:2352:x1874668629821056:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 80us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823600.329913:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 75 00000100:00100000:1.0:1787823600.329938:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629821184 00000100:00100000:1.0:1787823600.329942:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629821184 00000100:00100000:1.0:1787823600.330010:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 135 00000100:00100000:1.0:1787823600.330016:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2352:x1874668629821184:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787823600.330047:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2352:x1874668629821184:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 31us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823600.330065:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 135 00000100:00100000:2.0:1787823600.330248:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629820928 00000100:00100000:2.0:1787823600.330253:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629820928 00000100:00100000:2.0:1787823600.330289:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 288 00000100:00100000:2.0:1787823600.330298:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+13:2352:x1874668629820928:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787823600.330327:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+13:2352:x1874668629820928:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 31us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823600.330334:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 288 00000100:00080000:3.0:1787823600.330647:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787823600.330653:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787823600.501509:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823600.501634:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629821312 00000100:00100000:1.0:1787823600.501645:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629821312 00000100:00100000:1.0:1787823600.501928:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 55 00000100:00100000:1.0:1787823600.501941:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+36:10383:x1874668629821312:12345-192.168.202.35@tcp:101:stat.0 00010000:00010000:1.0:1787823600.501967:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823600.501987:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481b32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44765 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.502056:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481b39 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.502074:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481b39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.502088:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481b39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.502104:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481b40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.502111:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481b40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.502117:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481b40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.503200:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481b47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.503212:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.503221:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787823600.503257:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1787823600.503262:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787823600.503285:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.503296:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.503304:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481b39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.503310:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481b39 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.503317:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481b39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.503323:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f3a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823600.503327:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481b39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.503334:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481b39 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.503367:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e791767b200) 00010000:00010000:1.0:1787823600.503370:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823600.503374:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481b39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.503381:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481b39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.503394:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481b40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.503401:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481b40 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.503407:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481b40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.503412:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f3600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823600.503415:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481b40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.503421:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481b40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.503429:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e7917859500) 00010000:00010000:1.0:1787823600.503431:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823600.503434:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481b40 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.503439:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481b40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.503490:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481b32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44765 expref: 38 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.503504:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481b47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44765 expref: 37 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.503511:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e791767b300) 00010000:00010000:1.0:1787823600.503514:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787823600.503516:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a2f2200, rc 0) 00000100:00100000:1.0:1787823600.503716:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+37:10383:x1874668629821312:12345-192.168.202.35@tcp:101:stat.0 Request processed in 1769us (2208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823600.503725:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 55 00000100:00100000:2.0:1787823600.582642:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823600.582824:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629821568 00000100:00100000:1.0:1787823600.582835:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629821568 00000100:00100000:1.0:1787823600.582893:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 56 00000100:00100000:1.0:1787823600.582902:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+37:10393:x1874668629821568:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:1.0:1787823600.583419:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823600.583439:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481b4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f4476c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787823600.583677:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1787823600.585862:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481b4e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4476c expref: 39 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.585882:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e791767b600) 00010000:00010000:1.0:1787823600.585884:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787823600.585903:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481b4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4476c expref: 39 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.585922:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a2f2800, rc 0) 00000100:00100000:1.0:1787823600.586007:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+38:10393:x1874668629821568:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 3105us (3376us total) trans 4294967340 rc 301/301 00000100:00100000:1.0:1787823600.586016:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 56 00000100:00100000:3.0:1787823600.588378:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823600.588488:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629821824 00000100:00100000:1.0:1787823600.588498:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629821824 00000100:00100000:1.0:1787823600.588553:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 14 00000100:00100000:1.0:1787823600.588564:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+38:10393:x1874668629821824:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:1.0:1787823600.589049:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+39:10393:x1874668629821824:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 485us (678us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1787823600.589067:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 14 00000100:00100000:2.0:1787823600.702556:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823600.702673:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629822080 00000100:00100000:0.0:1787823600.703139:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629822080 00000100:00100000:0.0:1787823600.703289:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 57 00000100:00100000:0.0:1787823600.703301:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+39:10399:x1874668629822080:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:0.0:1787823600.703331:0:7893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823600.703433:0:7893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b832481b5c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44773 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.703545:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481b63 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.703560:0:7893:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481b47 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44765 expref: 40 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.703569:0:7893:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481b63 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.703604:0:7893:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481b47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44765 expref: 40 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.703617:0:7893:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481b47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44765 expref: 40 pid: 5840 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823600.703649:0:7893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792e809680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7893:1874668651872256:192.168.202.35@tcp:104: 00000100:00100000:0.0:1787823600.708363:0:7893:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908a3e480 going to sleep for 11 seconds 00000100:00100000:2.0:1787823600.713524:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823600.713818:0:7893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792e809680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7893:1874668651872256:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787823600.713851:0:7893:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481b63 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823600.714149:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629822208 00000100:00100000:3.0:1787823600.714158:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629822208 00010000:00010000:3.0:1787823600.714204:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481b47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44765 expref: 41 pid: 5840 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823600.714256:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 40 00000100:00100000:3.0:1787823600.714263:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:353832f0-fe7b-4d99-975c-a8041babed42+41:2353:x1874668629822208:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787823600.714275:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787823600.714281:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481b47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44765 expref: 41 pid: 5840 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823600.714290:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481b47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44765 expref: 41 pid: 5840 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823600.714308:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481b47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44765 expref: 41 pid: 5840 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823600.714321:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e791767b300) 00010000:00010000:3.0:1787823600.714325:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481b63 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823600.714332:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481b63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823600.714337:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481b63 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823600.714360:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787823600.714412:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:353832f0-fe7b-4d99-975c-a8041babed42+40:2353:x1874668629822208:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 149us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823600.714419:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 40 00010000:00010000:1.0:1787823600.714504:0:7893:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481b63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.714513:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481b63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787823600.714535:0:7893:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1787823600.714678:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b832481b5c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44773 expref: 41 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.714691:0:7893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481b63 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44773 expref: 40 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.714697:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e791767b300) 00010000:00010000:1.0:1787823600.714704:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787823600.714706:0:7893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40fe00, rc 0) 00000100:00100000:1.0:1787823600.715097:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+40:10399:x1874668629822080:12345-192.168.202.35@tcp:101:bash.0 Request processed in 11797us (12553us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1787823600.715106:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 57 00000100:00100000:0.0:1787823600.723291:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823600.723564:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629822464 00000100:00100000:3.0:1787823600.723585:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629822464 00000100:00100000:3.0:1787823600.723638:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 58 00000100:00100000:3.0:1787823600.723646:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e809680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+40:10399:x1874668629822464:12345-192.168.202.35@tcp:36:bash.0 00010000:00010000:3.0:1787823600.723959:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481b71 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823600.723978:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481b71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823600.723987:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481b71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787823600.724028:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967343 00000004:00010000:3.0:1787823600.724054:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f407b828 reply state 000000000a0e11d3 transno 4294967344 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481b71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823600.724062:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787823600.724162:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e809680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+43:10399:x1874668629822464:12345-192.168.202.35@tcp:36:bash.0 Request processed in 516us (879us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1787823600.724168:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 58 00000020:00080000:3.0:1787823600.724172:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787823600.729374:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481b71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.729387:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481b71 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.729392:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481b71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.729395:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eea600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823600.729399:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481b71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.729407:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481b71 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.729424:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e791767b300) 00010000:00010000:0.0:1787823600.729426:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823600.729432:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481b71 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.729438:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481b71 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823600.741389:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823600.741650:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629822592 00000100:00100000:3.0:1787823600.741660:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629822592 00000100:00100000:3.0:1787823600.741719:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 59 00000100:00100000:3.0:1787823600.741729:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+42:10399:x1874668629822592:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:3.0:1787823600.741799:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823600.741820:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b832481b78 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f4477a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823600.741904:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481b7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823600.741931:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481b63 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44773 expref: 43 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823600.741940:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481b7f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823600.741971:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481b63 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44773 expref: 43 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823600.741984:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481b63 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44773 expref: 43 pid: 7893 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823600.741997:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea8cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1874668651872384:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787823600.742071:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a79d780 going to sleep for 11 seconds 00000100:00100000:2.0:1787823600.745238:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823600.746083:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629822720 00000100:00100000:0.0:1787823600.746096:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629822720 00010000:00010000:0.0:1787823600.746141:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481b63 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44773 expref: 44 pid: 7893 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823600.746186:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 41 00000100:00100000:0.0:1787823600.746196:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:353832f0-fe7b-4d99-975c-a8041babed42+44:2352:x1874668629822720:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787823600.746212:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787823600.746218:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481b63 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44773 expref: 44 pid: 7893 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.746231:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481b63 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44773 expref: 44 pid: 7893 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.746253:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e791767b300) 00010000:00010000:0.0:1787823600.746258:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481b7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.746268:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481b7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.746275:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481b7f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823600.746299:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787823600.746349:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:353832f0-fe7b-4d99-975c-a8041babed42+44:2352:x1874668629822720:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 155us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823600.746374:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 41 00010000:00010000:3.0:1787823600.748093:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832481b63 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44773 expref: 43 pid: 7893 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823600.748120:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea8cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1874668651872384:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787823600.748148:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481b7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823600.748159:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481b7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823600.748165:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481b7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787823600.748224:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787823600.748244:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787823600.748270:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481b7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823600.748309:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b832481b78 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4477a expref: 43 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823600.748324:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481b7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4477a expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823600.748334:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e791767b300) 00010000:00010000:3.0:1787823600.748337:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787823600.748341:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7920eebc00, rc 0) 00000100:00100000:3.0:1787823600.750034:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+42:10399:x1874668629822592:12345-192.168.202.35@tcp:101:bash.0 Request processed in 6691us (7039us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823600.750052:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 59 00000100:00100000:2.0:1787823600.761855:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823600.765107:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629822976 00000100:00100000:3.0:1787823600.765123:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629822976 00000100:00100000:3.0:1787823600.765205:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 15 00000100:00100000:3.0:1787823600.765219:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7925a93850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+42:10399:x1874668629822976:12345-192.168.202.35@tcp:35:bash.0 00000100:00100000:2.0:1787823600.765933:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7925a93850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+43:10399:x1874668629822976:12345-192.168.202.35@tcp:35:bash.0 Request processed in 712us (4082us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1787823600.765944:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 15 00010000:00010000:1.0:1787823600.874288:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823600.888218:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823600.891519:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629823232 00000100:00100000:3.0:1787823600.891537:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629823232 00000100:00100000:3.0:1787823600.891620:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 60 00000100:00100000:3.0:1787823600.891632:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e808f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+43:10409:x1874668629823232:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:3.0:1787823600.891659:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823600.891679:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b832481b86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44781 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787823600.892366:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1787823600.894570:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b832481b86 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44781 expref: 45 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823600.894593:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e791767b600) 00010000:00010000:3.0:1787823600.894597:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787823600.894602:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b832481b86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44781 expref: 45 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823600.894624:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7920eea400, rc 0) 00000100:00100000:3.0:1787823600.895065:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e808f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+44:10409:x1874668629823232:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 3432us (6856us total) trans 4294967346 rc 301/301 00000100:00100000:3.0:1787823600.895076:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 60 00000100:00100000:0.0:1787823600.905335:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823600.905439:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629823360 00000100:00100000:1.0:1787823600.905450:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629823360 00000100:00100000:1.0:1787823600.905509:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 61 00000100:00100000:1.0:1787823600.905520:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+44:10409:x1874668629823360:12345-192.168.202.35@tcp:34:lfs.0 00010000:00010000:1.0:1787823600.905599:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481b94 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.905617:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481b94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.905629:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481b94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.905646:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481b9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.905654:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481b9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.905660:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481b9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.906005:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481ba2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.906024:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.906032:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787823600.906081:0:7893:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.906094:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481b94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.906101:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481b94 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.906108:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481b94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.906115:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f2800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823600.906119:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481b94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.906126:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481b94 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.906139:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e791767b200) 00010000:00010000:1.0:1787823600.906143:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823600.906148:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481b94 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.906154:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481b94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.906174:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481b9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.906180:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481b9b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.906187:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481b9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.906192:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f3600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823600.906195:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481b9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.906201:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481b9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.906209:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e7917859500) 00010000:00010000:1.0:1787823600.906211:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823600.906214:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481b9b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.906221:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481b9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.906234:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.906240:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481ba2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.906245:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.906255:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f3a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823600.906258:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.906264:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481ba2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.906271:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e791767b300) 00010000:00010000:1.0:1787823600.906273:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823600.906276:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481ba2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823600.906281:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481ba2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823600.906466:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+44:10409:x1874668629823360:12345-192.168.202.35@tcp:34:lfs.0 Request processed in 945us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823600.906474:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 61 00000100:00100000:2.0:1787823600.912354:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823600.913543:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629823616 00000100:00100000:0.0:1787823600.913562:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629823616 00000100:00100000:0.0:1787823600.913685:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 16 00000100:00100000:0.0:1787823600.913699:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+44:10409:x1874668629823616:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:0.0:1787823600.914613:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+45:10409:x1874668629823616:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 910us (2264us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1787823600.914624:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 16 00000100:00100000:0.0:1787823600.996651:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823600.996993:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629823872 00000100:00100000:2.0:1787823600.997003:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629823872 00000100:00100000:2.0:1787823600.997064:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 62 00000100:00100000:2.0:1787823600.997075:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e808780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+45:10412:x1874668629823872:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:2.0:1787823600.997100:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823600.997124:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832481ba9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44788 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823600.997195:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832481bb0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823600.997228:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832481bb0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823600.997240:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832481bb0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823600.997255:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481bb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823600.997262:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823600.997268:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823600.997600:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481bbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823600.997610:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481bbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823600.997618:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481bbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787823600.997627:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787823600.999577:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832481bb0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823600.999594:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832481bb0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823600.999602:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832481bb0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823600.999620:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d2a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823600.999625:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832481bb0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823600.999633:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832481bb0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823600.999647:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e791767b200) 00010000:00010000:2.0:1787823600.999650:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823600.999654:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832481bb0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823600.999660:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832481bb0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823600.999675:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823600.999681:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481bb7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823600.999687:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481bb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823600.999691:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823600.999694:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481bb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823600.999700:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481bb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823600.999715:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e79228da500) 00010000:00010000:2.0:1787823600.999717:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823600.999720:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481bb7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823600.999735:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481bb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823600.999842:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832481ba9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44788 expref: 48 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823601.000612:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481bbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44788 expref: 47 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823601.000623:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e791767b300) 00010000:00010000:2.0:1787823601.000625:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787823601.000628:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d3400, rc 0) 00000100:00100000:2.0:1787823601.000707:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e808780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+47:10412:x1874668629823872:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 3633us (4070us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1787823601.000716:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 62 00000100:00100000:2.0:1787823601.004258:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823601.004310:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823601.004382:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629824128 00000100:00100000:3.0:1787823601.004393:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629824128 00000100:00100000:3.0:1787823601.004475:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 4 00000100:00100000:3.0:1787823601.004488:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:353832f0-fe7b-4d99-975c-a8041babed42+47:2352:x1874668629824128:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787823601.004507:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787823601.004535:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481bbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44788 expref: 47 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.004554:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e791767b300) 00010000:00010000:3.0:1787823601.004560:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787823601.004680:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:353832f0-fe7b-4d99-975c-a8041babed42+46:2352:x1874668629824128:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 195us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823601.004710:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 4 00000100:00100000:1.0:1787823601.004725:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629824000 00000100:00100000:1.0:1787823601.004730:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629824000 00000100:00100000:1.0:1787823601.004793:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 63 00000100:00100000:1.0:1787823601.004801:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+46:10412:x1874668629824000:12345-192.168.202.35@tcp:54:lfs.0 00010000:00010000:1.0:1787823601.004863:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481bcc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.004878:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481bcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.004890:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481bcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.004993:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481bcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.005001:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481bcc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.005008:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481bcc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.005015:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f3a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823601.005020:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481bcc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.005027:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481bcc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.005037:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e791767b300) 00010000:00010000:1.0:1787823601.005041:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787823601.005046:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481bcc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.005052:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481bcc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823601.005094:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+46:10412:x1874668629824000:12345-192.168.202.35@tcp:54:lfs.0 Request processed in 293us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823601.005101:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 63 00000100:00100000:3.0:1787823601.012213:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823601.012322:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629824384 00000100:00100000:2.0:1787823601.012338:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629824384 00000100:00100000:2.0:1787823601.012414:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 17 00000100:00100000:2.0:1787823601.012426:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+46:10412:x1874668629824384:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:2.0:1787823601.012727:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+47:10412:x1874668629824384:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 302us (528us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1787823601.012786:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 17 00000100:00100000:2.0:1787823601.130239:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a49da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651872896:0@lo:400:kworker.0 00000100:00100000:2.0:1787823601.130325:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823601.130404:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787823601.130411:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e79360b83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874668651872768:0@lo:400:kworker.0 00000100:00100000:2.0:1787823601.130438:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823601.130542:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651872896 00000100:00100000:0.0:1787823601.130552:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651872896 00000100:00100000:0.0:1787823601.130634:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787823601.130644:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e93cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1874668651872896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823601.130704:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e93cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1874668651872896:12345-0@lo:400:kworker.0 Request processed in 61us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823601.130711:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787823601.130818:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a49da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651872896:0@lo:400:kworker.0 00000100:00100000:1.0:1787823601.130913:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651872512:0@lo:400:kworker.0 00000100:00100000:1.0:1787823601.130948:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823601.130991:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792e93c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874668651873024:0@lo:400:kworker.0 00000100:00100000:1.0:1787823601.131014:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823601.131034:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787823601.131039:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874668651872640:0@lo:400:kworker.0 00000100:00100000:1.0:1787823601.131058:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823601.131072:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792e93f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651873152:0@lo:400:kworker.0 00000100:00100000:1.0:1787823601.131091:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823601.131118:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651873152 00000100:00100000:1.0:1787823601.131122:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651873152 00000100:00100000:1.0:1787823601.131148:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787823601.131154:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0eda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651873152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823601.131187:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0eda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651873152:12345-0@lo:400:kworker.0 Request processed in 33us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823601.131194:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787823601.131218:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792e93f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651873152:0@lo:400:kworker.0 00000100:00100000:1.0:1787823601.131237:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651872768 00000100:00100000:1.0:1787823601.131240:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651872768 00000100:00100000:1.0:1787823601.131266:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651873024 00000100:00100000:1.0:1787823601.131270:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651873024 00000100:00100000:1.0:1787823601.131283:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651872640 00000100:00100000:1.0:1787823601.131285:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651872640 00000100:00100000:1.0:1787823601.131297:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787823601.131305:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e93f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874668651872768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823601.131338:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e93f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874668651872768:12345-0@lo:400:kworker.0 Request processed in 33us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823601.131344:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787823601.131355:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787823601.131368:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874668651873024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823601.131402:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874668651873024:12345-0@lo:400:kworker.0 Request processed in 35us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823601.131409:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787823601.131420:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787823601.131426:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874668651872640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823601.131452:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874668651872640:12345-0@lo:400:kworker.0 Request processed in 26us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823601.131458:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787823601.131481:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874668651872640:0@lo:400:kworker.0 00000100:00100000:1.0:1787823601.131491:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792e93c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874668651873024:0@lo:400:kworker.0 00000100:00100000:0.0:1787823601.131629:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651872512 00000100:00100000:0.0:1787823601.131633:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651872512 00000100:00100000:0.0:1787823601.131668:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1787823601.131675:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3305:x1874668651872512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823601.131717:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3305:x1874668651872512:12345-0@lo:400:kworker.0 Request processed in 43us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823601.131733:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1787823601.131812:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651872512:0@lo:400:kworker.0 00000100:00100000:0.0:1787823601.131837:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e79360b83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874668651872768:0@lo:400:kworker.0 00000100:00080000:2.0:1787823601.132036:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787823601.132042:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787823601.132044:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787823601.180274:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823601.180682:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629824640 00000100:00100000:1.0:1787823601.180695:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629824640 00000100:00100000:1.0:1787823601.180803:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 64 00000100:00100000:1.0:1787823601.180815:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+47:10430:x1874668629824640:12345-192.168.202.35@tcp:101:cat.0 00010000:00010000:1.0:1787823601.180857:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823601.180881:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481bd3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f4478f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.181005:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481bda lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.181022:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481bda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.181036:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481bda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787823601.181060:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787823601.181181:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481bd3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4478f expref: 50 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.181195:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481bda lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4478f expref: 49 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.181202:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e791767b300) 00010000:00010000:1.0:1787823601.181204:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787823601.181208:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a2f3600, rc 0) 00000100:00100000:1.0:1787823601.181268:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+49:10430:x1874668629824640:12345-192.168.202.35@tcp:101:cat.0 Request processed in 457us (1006us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1787823601.181275:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 64 00000100:00100000:3.0:1787823601.209162:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823601.209293:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629824768 00000100:00100000:0.0:1787823601.209303:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629824768 00000100:00100000:0.0:1787823601.209421:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 65 00000100:00100000:0.0:1787823601.209433:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+49:10431:x1874668629824768:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787823601.209458:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823601.209491:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481be8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44796 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.209563:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832481bef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.209581:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832481bef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.209591:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832481bef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787823601.209875:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787823601.209879:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787823601.209972:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832481bef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.210021:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481be8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44796 expref: 51 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.210054:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832481bef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44796 expref: 50 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.210063:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e791767b200) 00010000:00010000:0.0:1787823601.210066:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787823601.210070:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40e000, rc 0) 00000100:00100000:0.0:1787823601.210273:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+50:10431:x1874668629824768:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 841us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823601.210282:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 65 00000100:00100000:3.0:1787823601.215556:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823601.215636:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629825152 00000100:00100000:2.0:1787823601.215645:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629825152 00000100:00100000:2.0:1787823601.215724:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 18 00000100:00100000:2.0:1787823601.215732:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+50:10431:x1874668629825152:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:2.0:1787823601.216180:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+51:10431:x1874668629825152:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 446us (633us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1787823601.216189:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 18 00000100:00100000:2.0:1787823601.218019:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823601.218151:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629825280 00000100:00100000:0.0:1787823601.218160:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629825280 00000100:00100000:0.0:1787823601.218225:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 5 00000100:00100000:0.0:1787823601.218235:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e93de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:353832f0-fe7b-4d99-975c-a8041babed42+51:10431:x1874668629825280:12345-192.168.202.35@tcp:103:lfs.0 00010000:00010000:0.0:1787823601.218249:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787823601.218278:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481b7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4477a expref: 51 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.218301:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481bda lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4478f expref: 50 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.218314:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481a8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4473b expref: 49 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.218325:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e791767b300) 00010000:00010000:0.0:1787823601.218334:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787823601.218398:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e93de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:353832f0-fe7b-4d99-975c-a8041babed42+48:10431:x1874668629825280:12345-192.168.202.35@tcp:103:lfs.0 Request processed in 164us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823601.218406:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 5 00000100:00100000:3.0:1787823601.220945:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823601.221362:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629825408 00000100:00100000:1.0:1787823601.221372:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629825408 00000100:00100000:1.0:1787823601.221446:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 66 00000100:00100000:1.0:1787823601.221459:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+48:10431:x1874668629825408:12345-192.168.202.35@tcp:58:lfs.0 00010000:00010000:1.0:1787823601.221605:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481bf6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.221623:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481bf6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.221635:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481bf6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787823601.223864:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787823601.224129:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1787823601.224208:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1787823601.224335:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+48:10431:x1874668629825408:12345-192.168.202.35@tcp:58:lfs.0 Request processed in 2872us (3394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823601.224350:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 66 00000100:00100000:3.0:1787823601.253807:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823601.254225:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629825536 00000100:00100000:0.0:1787823601.254236:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629825536 00000100:00100000:0.0:1787823601.254293:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 67 00000100:00100000:0.0:1787823601.254303:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+48:10433:x1874668629825536:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787823601.254323:0:7893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823601.254342:0:7893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481bfd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f4479d expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.254402:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481c04 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.254416:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481c04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.254427:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481c04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.254443:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481c0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.254450:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481c0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.254456:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481c0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.254942:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b832481c12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.254967:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b832481c12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.254975:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b832481c12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787823601.255080:0:7893:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787823601.255084:0:7893:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787823601.255102:0:7893:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b832481c12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.255115:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b832481c12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.255124:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481c04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.255131:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481c04 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.255138:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481c04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.255145:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40f800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823601.255149:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481c04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.255157:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481c04 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.255168:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e791767b200) 00010000:00010000:0.0:1787823601.255170:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823601.255183:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481c04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.255190:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481c04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.255202:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481c0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.255208:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481c0b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.255215:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481c0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.255220:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40f000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823601.255223:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481c0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.255229:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481c0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.255236:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e791767b300) 00010000:00010000:0.0:1787823601.255239:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823601.255242:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481c0b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.255248:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481c0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.255279:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481bfd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4479d expref: 50 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.255303:0:7893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b832481c12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4479d expref: 49 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.255310:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e7917859500) 00010000:00010000:0.0:1787823601.255312:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787823601.255315:0:7893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40ea00, rc 0) 00000100:00100000:0.0:1787823601.255385:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+49:10433:x1874668629825536:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 1083us (1636us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823601.255392:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 67 00000040:00080000:1.0:1787823601.322049:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787823601.322062:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787823601.322125:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787823601.322132:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787823601.322286:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a0ee940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1874668651873280:192.168.202.35@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787823601.322586:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908f8cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787823601.335933:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823601.336152:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629825664 00000100:00100000:2.0:1787823601.336162:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629825664 00000100:00100000:2.0:1787823601.336232:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 1 00000100:00100000:2.0:1787823601.336245:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:353832f0-fe7b-4d99-975c-a8041babed42+50:10444:x1874668629825664:12345-192.168.202.35@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787823601.336340:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:353832f0-fe7b-4d99-975c-a8041babed42+50:10444:x1874668629825664:12345-192.168.202.35@tcp:900:lhsmtool_posix.0 Request processed in 99us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823601.336348:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 1 00000100:00100000:1.0:1787823601.337566:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a0ee940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1874668651873280:192.168.202.35@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787823601.339878:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823601.340826:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629825792 00000100:00100000:1.0:1787823601.340840:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629825792 00000100:00100000:1.0:1787823601.340909:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 68 00000100:00100000:1.0:1787823601.340921:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e93fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+49:10444:x1874668629825792:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787823601.340954:0:5838:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787823601.341072:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e93fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+49:10444:x1874668629825792:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 Request processed in 153us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823601.341081:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 68 00000100:00100000:2.0:1787823601.347413:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823601.347527:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629825920 00000100:00100000:0.0:1787823601.347538:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629825920 00000100:00100000:0.0:1787823601.347610:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 69 00000100:00100000:0.0:1787823601.347623:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e93f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+49:10444:x1874668629825920:12345-192.168.202.35@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787823601.347710:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481c19 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.347729:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481c19 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.347743:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481c19 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.347786:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481c20 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.347794:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481c20 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.347811:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481c20 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.347862:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481c27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.347870:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481c27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.347876:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481c27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787823601.347923:0:7893:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787823601.347928:0:7893:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787823601.347941:0:7893:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481c27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.347953:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481c19 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.347960:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481c19 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.347967:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481c19 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.347974:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40e600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823601.348316:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481c19 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.348327:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481c19 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.348349:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e7917859800) 00010000:00010000:0.0:1787823601.348352:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823601.348356:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481c19 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.348362:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481c19 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.348377:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481c20 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.348383:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481c20 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.348388:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481c20 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.348393:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40f000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823601.348396:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481c20 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.348402:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481c20 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.348409:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8e791767b300) 00010000:00010000:0.0:1787823601.348411:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823601.348414:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481c20 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.348419:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481c20 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.348443:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481c27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.348450:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481c27 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.348456:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481c27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.348460:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40f800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823601.348463:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481c27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.348468:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481c27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.348476:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e7917859500) 00010000:00010000:0.0:1787823601.348479:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823601.348481:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481c27 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.348487:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481c27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823601.348586:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e93f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+49:10444:x1874668629825920:12345-192.168.202.35@tcp:34:lhsmtool_posix.0 Request processed in 964us (1188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823601.348595:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 69 00000100:00100000:2.0:1787823601.355212:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823601.355453:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629826176 00000100:00100000:1.0:1787823601.355465:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629826176 00000100:00100000:1.0:1787823601.355535:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 70 00000100:00100000:1.0:1787823601.355547:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e93e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+49:10444:x1874668629826176:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787823601.355570:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823601.355594:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481c2e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f447a4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.355736:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481c35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.355781:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481c35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.355795:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481c35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787823601.355809:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787823601.355929:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481c35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.355937:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481c35 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.355944:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481c35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.355951:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f2a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823601.355955:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481c35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.355962:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481c35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.355974:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e7917859500) 00010000:00010000:1.0:1787823601.355977:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787823601.355982:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481c35 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.355999:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481c35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.356046:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481c2e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447a4 expref: 51 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.356058:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e7917859800) 00010000:00010000:1.0:1787823601.356061:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787823601.356064:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481c2e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447a4 expref: 51 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.356074:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a2f2800, rc 0) 00000100:00100000:1.0:1787823601.356146:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e93e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+50:10444:x1874668629826176:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 602us (945us total) trans 4294967352 rc 301/301 00000100:00100000:1.0:1787823601.356154:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 70 00000100:00100000:3.0:1787823601.360513:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823601.360909:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629826304 00000100:00100000:1.0:1787823601.360921:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629826304 00000100:00100000:1.0:1787823601.360982:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 71 00000100:00100000:1.0:1787823601.360994:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+50:10444:x1874668629826304:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787823601.361034:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787823601.361155:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+50:10444:x1874668629826304:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 Request processed in 163us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823601.361163:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 71 00000100:00100000:1.0:1787823601.368542:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823601.368629:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629826560 00000100:00100000:3.0:1787823601.368644:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629826560 00000100:00100000:3.0:1787823601.368794:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 72 00000100:00100000:3.0:1787823601.368805:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+50:10444:x1874668629826560:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787823601.368829:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823601.368845:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787823601.368885:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832481bef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44796 expref: 50 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.368915:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e791767b200) 00010000:00010000:3.0:1787823601.368921:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787823601.368939:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b832481c43 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f447ab expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787823601.370708:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1787823601.371444:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832481c4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.371464:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832481c4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.371556:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832481c4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.371635:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b832481c43 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447ab expref: 52 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.371656:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832481c4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447ab expref: 51 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.371667:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e79087c9f00) 00010000:00010000:3.0:1787823601.371671:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787823601.371675:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7920eeac00, rc 0) 00000100:00100000:3.0:1787823601.372450:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+51:10444:x1874668629826560:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 3639us (3920us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1787823601.372462:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 72 00000100:00100000:3.0:1787823601.379583:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823601.379846:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629826816 00000100:00100000:1.0:1787823601.379857:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629826816 00000100:00100000:1.0:1787823601.379928:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 73 00000100:00100000:1.0:1787823601.379940:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+51:10444:x1874668629826816:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787823601.380012:0:7893:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823601.380042:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832481c4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447ab expref: 51 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.380062:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e79087c9f00) 00010000:00010000:1.0:1787823601.380074:0:7893:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787823601.380101:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481c58 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.380115:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481c58 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.380125:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481c58 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.380139:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481c5f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x500b0d88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.380146:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481c5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x500b0d88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.380152:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481c5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x500b0d88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.380497:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481c58 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.380506:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481c58 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.380522:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481c58 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.380528:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f2800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823601.380533:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481c58 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.380540:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481c58 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.380548:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e791767b200) 00010000:00010000:1.0:1787823601.380551:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823601.380554:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481c58 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.380560:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481c58 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.380570:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481c5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x500b0d88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.380576:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481c5f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x500b0d88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.380582:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481c5f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x500b0d88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.380587:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f2a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823601.380590:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481c5f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x500b0d88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.380604:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481c5f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x500b0d88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.380612:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x500b0d88 (ffff8e7917859f00) 00010000:00010000:1.0:1787823601.380614:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823601.380617:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481c5f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x500b0d88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.380623:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481c5f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x500b0d88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823601.380727:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+50:10444:x1874668629826816:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 Request processed in 787us (1153us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787823601.380734:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 73 00000100:00100000:1.0:1787823601.385962:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823601.386509:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629826944 00000100:00100000:3.0:1787823601.386520:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629826944 00000100:00100000:3.0:1787823601.386586:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 74 00000100:00100000:3.0:1787823601.386597:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+50:10444:x1874668629826944:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787823601.386618:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823601.386643:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481c66 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f447b2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.386681:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481c6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.386711:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481c6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.386723:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481c6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.386859:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481c66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447b2 expref: 52 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.386880:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481c6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447b2 expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.386888:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e79087c9600) 00010000:00010000:3.0:1787823601.386903:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787823601.386907:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7920eebc00, rc 0) 00000100:00100000:3.0:1787823601.386983:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+51:10444:x1874668629826944:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 387us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823601.386991:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 74 00000100:00100000:1.0:1787823601.389807:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823601.389916:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629827200 00000100:00100000:0.0:1787823601.389927:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629827200 00000100:00100000:0.0:1787823601.389983:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 75 00000100:00100000:0.0:1787823601.390004:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+51:10444:x1874668629827200:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787823601.390089:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481c74 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.390106:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481c74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.390118:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481c74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787823601.390408:0:7893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:0.0:1787823601.390688:0:7893:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 342244928351ns, next at 343244925070ns, rc = 0 00000004:00010000:0.0:1787823601.390835:0:7893:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006b00a0ef reply state 00000000bccd00eb transno 4294967354 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481c74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823601.390846:0:7893:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787823601.390961:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+53:10444:x1874668629827200:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 Request processed in 957us (1161us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1787823601.390969:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 75 00010000:00010000:3.0:1787823601.403844:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481c74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.403863:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481c74 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.403872:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481c74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.403879:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40f000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823601.403884:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481c74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.403917:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481c74 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.403937:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e79087c9600) 00010000:00010000:3.0:1787823601.403941:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787823601.403946:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481c74 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.403951:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481c74 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823601.410061:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823601.412587:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629827328 00000100:00100000:2.0:1787823601.412603:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629827328 00000100:00100000:2.0:1787823601.412681:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 76 00000100:00100000:2.0:1787823601.412693:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+52:10444:x1874668629827328:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787823601.412731:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823601.412870:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481c7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f447b9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823601.413003:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481c7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447b9 expref: 53 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823601.413021:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481c7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447b9 expref: 53 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823601.413042:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e79087c9600) 00010000:00010000:2.0:1787823601.413046:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787823601.413050:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d2200, rc 0) 00000100:00100000:2.0:1787823601.413165:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+53:10444:x1874668629827328:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 473us (3112us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823601.413172:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 76 00000100:00100000:0.0:1787823601.419008:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823601.419157:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629827456 00000100:00100000:2.0:1787823601.419170:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629827456 00000100:00100000:2.0:1787823601.419227:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 24 00000100:00100000:2.0:1787823601.419236:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79360b83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1874668629827456:12345-192.168.202.35@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1787823601.419270:0:6688:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from 353832f0-fe7b-4d99-975c-a8041babed42@192.168.202.35@tcp t0 exp 0000000000000000 cur 342 last 0 00000020:00000080:2.0:1787823601.419315:0:6688:0:(genops.c:1385:class_connect()) connect: client 353832f0-fe7b-4d99-975c-a8041babed42, cookie 0x5d1142b832481c82 00002000:00100000:2.0:1787823601.419328:0:6688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 353832f0-fe7b-4d99-975c-a8041babed42/ffff8e7938a01000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787823601.419352:0:6688:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787823601.419810:0:6688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787823601.419843:0:6688:0:(import.c:65:import_set_state_nolock()) ffff8e7938a03000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787823601.420560:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79360b83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:353832f0-fe7b-4d99-975c-a8041babed42+6:2351:x1874668629827456:12345-192.168.202.35@tcp:8:lhsmtool_posix.0 Request processed in 1317us (1558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823601.420571:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 24 00000100:00100000:3.0:1787823601.426105:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823601.428106:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629827584 00000100:00100000:0.0:1787823601.428125:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629827584 00000100:00100000:0.0:1787823601.428223:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 25 00000100:00100000:0.0:1787823601.428234:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+6:0:x1874668629827584:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1787823601.428872:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787823601.468089:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+7:0:x1874668629827584:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 Request processed in 39844us (41985us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787823601.468104:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 25 00000001:00080000:3.0:1787823601.468236:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:3.0:1787823601.468247:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 353832f0-fe7b-4d99-975c-a8041babed42 00000100:00100000:3.0:1787823601.470789:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823601.471582:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629827840 00000100:00100000:1.0:1787823601.471593:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629827840 00000100:00100000:1.0:1787823601.471642:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 19 00000100:00100000:1.0:1787823601.471649:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+53:10444:x1874668629827840:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787823601.471869:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+54:10444:x1874668629827840:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 Request processed in 219us (1091us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1787823601.471874:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 19 00000100:00100000:1.0:1787823601.478477:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823601.478606:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629828096 00000100:00100000:3.0:1787823601.478618:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629828096 00000100:00100000:3.0:1787823601.478683:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 77 00000100:00100000:3.0:1787823601.478693:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+54:10444:x1874668629828096:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787823601.478833:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+54:10444:x1874668629828096:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 Request processed in 142us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823601.478841:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 77 00000100:00100000:3.0:1787823601.486179:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823601.486272:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629828224 00000100:00100000:1.0:1787823601.486282:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629828224 00000100:00100000:1.0:1787823601.486331:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 78 00000100:00100000:1.0:1787823601.486348:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+54:10444:x1874668629828224:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787823601.486370:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823601.486508:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481c89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f447c0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.486587:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481c90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.486605:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481c90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.486618:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481c90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787823601.486654:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787823601.487312:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481c90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.487347:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481c89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447c0 expref: 56 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.487365:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481c90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447c0 expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.487375:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e79087c9600) 00010000:00010000:1.0:1787823601.487378:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787823601.487382:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a2f2200, rc 0) 00000100:00100000:1.0:1787823601.487537:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+55:10444:x1874668629828224:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 1190us (1366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823601.487552:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 78 00000100:00100000:3.0:1787823601.489711:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823601.490102:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629828352 00000100:00100000:2.0:1787823601.490111:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629828352 00000100:00100000:2.0:1787823601.490284:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 26 00000100:00100000:2.0:1787823601.490294:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:353832f0-fe7b-4d99-975c-a8041babed42+5:2354:x1874668629828352:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787823601.490310:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823601.490330:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b832481c97 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f447c7 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787823601.490356:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9005f1, blocks: 0x1 00010000:00010000:2.0:1787823601.490373:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=342s v=(0 0) 00010000:00010000:2.0:1787823601.490377:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823601.490386:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b832481c97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447c7 expref: 6 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823601.490414:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b832481c97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447c7 expref: 6 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823601.490434:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d3c00, rc 0) 00000100:00100000:2.0:1787823601.490502:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:353832f0-fe7b-4d99-975c-a8041babed42+6:2354:x1874668629828352:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 209us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823601.490510:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 26 00000100:00100000:0.0:1787823601.492926:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823601.493001:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629828608 00000100:00100000:3.0:1787823601.493022:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629828608 00000100:00100000:3.0:1787823601.493080:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 79 00000100:00100000:3.0:1787823601.493089:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a49da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+55:10444:x1874668629828608:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787823601.493185:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a49da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+55:10444:x1874668629828608:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 Request processed in 97us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823601.493193:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 79 00000100:00100000:0.0:1787823601.495731:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823601.495842:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629828736 00000100:00100000:2.0:1787823601.495852:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629828736 00000100:00100000:2.0:1787823601.495902:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 27 00000100:00100000:2.0:1787823601.495911:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+6:10444:x1874668629828736:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787823601.495933:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823601.495954:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832481c9e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f447ce expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823601.495990:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b832481c97 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447c7 expref: 7 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823601.496000:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823601.496005:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823601.496011:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832481c9e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447ce expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823601.496050:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b832481c97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447c7 expref: 7 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823601.496065:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b832481c97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447c7 expref: 7 pid: 6688 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823601.496093:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792e93da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6686:1874668651873408:192.168.202.35@tcp:104: 00000100:00100000:2.0:1787823601.496195:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7906d763c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787823601.499830:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823601.499957:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629828864 00000100:00100000:1.0:1787823601.499964:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629828864 00000100:00100000:2.0:1787823601.499968:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792e93da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6686:1874668651873408:192.168.202.35@tcp:104: 00010000:00010000:2.0:1787823601.500002:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832481c9e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447ce expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.500010:0:7631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b832481c97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447c7 expref: 8 pid: 6688 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823601.500023:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d2c00, rc 0) 00000100:00100000:1.0:1787823601.500035:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 42 00000100:00100000:1.0:1787823601.500043:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909a22c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:353832f0-fe7b-4d99-975c-a8041babed42+8:2352:x1874668629828864:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787823601.500056:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787823601.500078:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+8:10444:x1874668629828736:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 4167us (4358us total) trans 0 rc 0/0 00010000:00010000:1.0:1787823601.500078:0:7631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b832481c97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447c7 expref: 8 pid: 6688 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823601.500086:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 27 00010000:00010000:1.0:1787823601.500091:0:7631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b832481c97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447c7 expref: 8 pid: 6688 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.500116:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b832481c97 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447c7 expref: 7 pid: 6688 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.500128:0:7631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787823601.500132:0:7631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787823601.500139:0:7631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832481c9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447ce expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.500150:0:7631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832481c9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447ce expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.500197:0:7631:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832481c9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447ce expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823601.500212:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a0ecb40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7631:1874668651873536:192.168.202.35@tcp:105: 00000100:00100000:1.0:1787823601.500277:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908f8ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787823601.511318:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823601.511414:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629828992 00000100:00100000:2.0:1787823601.511425:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629828992 00002000:00100000:2.0:1787823601.511485:0:6693:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8e792e80f0c0 x1874668629828992/t0(0) o4->353832f0-fe7b-4d99-975c-a8041babed42@192.168.202.35@tcp:222/0 lens 504/0 e 0 to 0 dl 1787823612 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787823601.511498:0:6693:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8e792e80f0c0 with x1874668629828992 ext(0->8) 00002000:00010000:2.0:1787823601.511503:0:6693:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e792e80f0c0 00000100:00100000:2.0:1787823601.511535:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 0 00000100:00100000:2.0:1787823601.511545:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:353832f0-fe7b-4d99-975c-a8041babed42+7:2355:x1874668629828992:12345-192.168.202.35@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787823601.511918:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a0ecb40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7631:1874668651873536:192.168.202.35@tcp:105: 00010000:00010000:1.0:1787823601.511940:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823601.512124:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909a22c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:353832f0-fe7b-4d99-975c-a8041babed42+7:2352:x1874668629828864:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 12080us (12304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823601.512133:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 42 00000100:00100000:2.0:1787823601.512391:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:353832f0-fe7b-4d99-975c-a8041babed42+8:2355:x1874668629828992:12345-192.168.202.35@tcp:4:lhsmtool_posix.0 Request processed in 847us (1083us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787823601.512399:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 0 00002000:00100000:2.0:1787823601.512406:0:6693:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8e792e80f0c0 x1874668629828992/t4294967302(0) o4->353832f0-fe7b-4d99-975c-a8041babed42@192.168.202.35@tcp:222/0 lens 504/448 e 0 to 0 dl 1787823612 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787823601.512594:0:6693:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8e792e80f0c0 with x1874668629828992 ext(0->8) 00002000:00010000:2.0:1787823601.512598:0:6693:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e792e80f0c0 00000100:00100000:2.0:1787823601.518526:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823601.518634:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629829120 00000100:00100000:3.0:1787823601.518644:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629829120 00000100:00100000:3.0:1787823601.518708:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 80 00000100:00100000:3.0:1787823601.518719:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e93da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+55:10444:x1874668629829120:12345-192.168.202.35@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787823601.568279:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:0.0:1787823601.568293:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000001:00080000:0.0:1787823601.568333:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967355 is committed 00000004:00080000:0.0:1787823601.568380:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:0.0:1787823601.568408:0:5860:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e793a47a840 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1787823601.568419:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e790522f800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e793a47a3c0 00000020:00080000:0.0:1787823601.568423:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e790522fe00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e7939d88c00 00000020:00080000:0.0:1787823601.568482:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1787823601.568618:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1787823601.569148:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792e80de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651873664:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787823601.569223:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823601.569304:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787823601.569311:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792e93e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651873792:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787823601.569336:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823601.569619:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651873664 00000100:00100000:3.0:1787823601.569627:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651873664 00000100:00100000:3.0:1787823601.569675:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651873792 00000100:00100000:3.0:1787823601.569679:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651873792 00000100:00100000:3.0:1787823601.569695:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787823601.569704:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1874668651873664:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787823601.569728:0:6687:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1787823601.569796:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9005ef, atime: 0x6a9005ef, ctime: 0x6a9005ef, blocks: 0x1 00010000:00010000:3.0:1787823601.569806:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076ad0d6e/0x5d1142b832481ca5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.569823:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=342s v=(0 0) 00010000:00010000:3.0:1787823601.569827:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787823601.569834:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076ad0d6e/0x5d1142b832481ca5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.569867:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076ad0d6e/0x5d1142b832481ca5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.569877:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076ad0d6e/0x5d1142b832481ca5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.569884:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076ad0d6e/0x5d1142b832481ca5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.569904:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787823601.570543:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1874668651873664:12345-0@lo:6:osp-syn-0-0.0 Request processed in 838us (1318us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787823601.570554:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787823601.570585:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787823601.570595:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4c9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651873792:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787823601.570714:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787823601.570718:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787823602 00002000:00010000:3.0:1787823601.570720:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787823601.570722:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787823601 -> 1787823602 00002000:00010000:3.0:1787823601.570724:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787823601.570814:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4c9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1874668651873792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 221us (1476us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787823601.570821:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:3.0:1787823601.570843:0:7629:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787823601.570850:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076ad0d6e/0x5d1142b832481ca5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.570868:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eea400 already unused, calling callback (ffffffffc1649440) 00010000:00010000:3.0:1787823601.570872:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076ad0d6e/0x5d1142b832481ca5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.570881:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076ad0d6e/0x5d1142b832481ca5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.570901:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076ad0d6e/0x5d1142b832481ca5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.570909:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076ad0d6e/0x5d1142b832481ca5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.570930:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823601.570932:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823601.570934:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787823601.571351:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e792e93e940/2, rc 0, transno 4294967303 00000100:00100000:0.0:1787823601.571362:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792e93e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651873792:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1787823601.571377:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e792e80de00/2, rc 0, transno 4294967301 00000100:00100000:0.0:1787823601.571382:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792e80de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651873664:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787823601.572034:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e93da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+13:10444:x1874668629829120:12345-192.168.202.35@tcp:44:lhsmtool_posix.0 Request processed in 53311us (53512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823601.572044:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 80 00000100:00100000:2.0:1787823601.586481:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823601.586734:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629829248 00000100:00100000:3.0:1787823601.586756:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629829248 00000100:00100000:2.0:1787823601.589732:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 30 00000100:00100000:2.0:1787823601.589756:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e93c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+8:2355:x1874668629829248:12345-192.168.202.35@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787823601.634819:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:0.0:1787823601.634854:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:2.0:1787823601.635190:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e93c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+6:2355:x1874668629829248:12345-192.168.202.35@tcp:16:lhsmtool_posix.0 Request processed in 45438us (48715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823601.635203:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 30 00000100:00100000:0.0:1787823601.642073:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792e93d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651873920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787823601.642157:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823601.642275:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651873920 00000100:00100000:2.0:1787823601.642284:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651873920 00000100:00100000:2.0:1787823601.642340:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787823601.642349:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926244b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651873920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787823601.642372:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1787823601.642422:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926244b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651873920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823601.642429:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787823601.642570:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1787823601.642576:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e792e93e940, transno 4294967303 00000100:00100000:0.0:1787823601.642597:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792e93d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651873920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787823601.651400:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823601.652074:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629829504 00000100:00100000:3.0:1787823601.652087:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629829504 00000100:00100000:3.0:1787823601.652162:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 81 00000100:00100000:3.0:1787823601.652171:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e93e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+13:10444:x1874668629829504:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787823601.652234:0:7893:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787823601.652264:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481c90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447c0 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.652295:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e79087c9600) 00010000:00010000:3.0:1787823601.652301:0:7893:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787823601.652333:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481cac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.652345:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481cac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.652355:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481cac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787823601.652725:0:7893:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005bbc1654 reply state 00000000ebe57030 transno 4294967356 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481cac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823601.652735:0:7893:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787823601.652869:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e93e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+14:10444:x1874668629829504:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 Request processed in 697us (1480us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1787823601.652877:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 81 00000100:00100000:3.0:1787823601.657484:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823601.657600:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629829632 00000100:00100000:2.0:1787823601.657611:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629829632 00000100:00100000:2.0:1787823601.657669:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 31 00000100:00100000:2.0:1787823601.657678:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+6:2355:x1874668629829632:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787823601.657960:0:6686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787823601.657964:0:6686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787823602 -> 1787823601 00002000:00010000:2.0:1787823601.657986:0:6686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787823599 00002000:00010000:2.0:1787823601.657989:0:6686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787823602 -> 1787823601 00002000:00010000:2.0:1787823601.657992:0:6686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787823601.658055:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+7:2355:x1874668629829632:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 Request processed in 377us (591us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787823601.658063:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 31 00010000:00010000:1.0:1787823601.658645:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481cac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.658660:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481cac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.658668:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481cac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.658674:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eeaa00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823601.658679:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481cac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.658699:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481cac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.658715:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e79087c9600) 00010000:00010000:1.0:1787823601.658718:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823601.658723:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481cac lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.658730:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481cac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823601.688007:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823601.688200:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629829888 00000100:00100000:2.0:1787823601.688211:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629829888 00000100:00100000:2.0:1787823601.688282:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 82 00000100:00100000:2.0:1787823601.688293:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+13:10444:x1874668629829888:12345-192.168.202.35@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787823601.688371:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481cb3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823601.688389:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481c6d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447b2 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823601.688399:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481cb3 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823601.688434:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481c6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447b2 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823601.688446:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481c6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447b2 expref: 13 pid: 5838 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823601.688461:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792e93ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1874668651874048:192.168.202.35@tcp:104: 00000100:00100000:2.0:1787823601.688556:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a47a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787823601.690718:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792e93ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1874668651874048:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787823601.690778:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481cb3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823601.691377:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823601.691615:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629830016 00000100:00100000:2.0:1787823601.691638:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629830016 00010000:00010000:2.0:1787823601.691678:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481c6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447b2 expref: 14 pid: 5838 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823601.691713:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 43 00000100:00100000:2.0:1787823601.691722:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:353832f0-fe7b-4d99-975c-a8041babed42+14:2353:x1874668629830016:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787823601.691737:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787823601.691743:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481c6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447b2 expref: 14 pid: 5838 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823601.691782:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481c6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447b2 expref: 14 pid: 5838 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823601.691805:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481c6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447b2 expref: 14 pid: 5838 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823601.691823:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e79087c9600) 00010000:00010000:2.0:1787823601.691829:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481cb3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823601.691840:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481cb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823601.691848:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481cb3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823601.691872:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787823601.691937:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:353832f0-fe7b-4d99-975c-a8041babed42+13:2353:x1874668629830016:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 213us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823601.691957:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 43 00010000:00010000:3.0:1787823601.692432:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481cb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.692440:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481cb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.692484:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481cb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.692491:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481cb3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.692497:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481cb3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.692502:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823601.692506:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481cb3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.692514:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481cb3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.692524:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e79087c9600) 00010000:00010000:3.0:1787823601.692527:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787823601.692531:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481cb3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.692537:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481cb3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823601.692598:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+12:10444:x1874668629829888:12345-192.168.202.35@tcp:55:lhsmtool_posix.0 Request processed in 4306us (4599us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787823601.692606:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 82 00000100:00100000:2.0:1787823601.704695:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823601.706800:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629830144 00000100:00100000:3.0:1787823601.706816:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629830144 00000100:00100000:3.0:1787823601.707131:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 32 00000100:00100000:3.0:1787823601.707154:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79049c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+7:2354:x1874668629830144:12345-192.168.202.35@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787823601.707209:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000076ad0d6e/0x5d1142b832481cba lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.707233:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832481c9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447ce expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.707242:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787823601.707247:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787823601.707252:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076ad0d6e/0x5d1142b832481cba lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.707293:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832481c9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447ce expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.707308:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832481c9e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447ce expref: 7 pid: 6686 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823601.707323:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792e80da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6687:1874668651874176:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787823601.707413:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7904707180 going to sleep for 11 seconds 00000100:00100000:3.0:1787823601.713232:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823601.724651:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629830272 00000100:00100000:3.0:1787823601.724668:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629830272 00010000:00010000:3.0:1787823601.724715:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832481c9e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447ce expref: 8 pid: 6686 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823601.724784:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 44 00000100:00100000:3.0:1787823601.724810:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:353832f0-fe7b-4d99-975c-a8041babed42+8:2352:x1874668629830272:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787823601.724827:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787823601.724855:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832481c9e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447ce expref: 8 pid: 6686 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.724870:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832481c9e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447ce expref: 8 pid: 6686 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.724973:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787823601.725053:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787823601.725060:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000076ad0d6e/0x5d1142b832481cba lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.725072:0:8457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076ad0d6e/0x5d1142b832481cba lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.725098:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787823601.725168:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:353832f0-fe7b-4d99-975c-a8041babed42+8:2352:x1874668629830272:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 360us (11945us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823601.725174:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 44 00010000:00010000:3.0:1787823601.727245:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832481c9e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447ce expref: 7 pid: 6686 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823601.727267:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792e80da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6687:1874668651874176:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787823601.727290:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000076ad0d6e/0x5d1142b832481cba lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.727318:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000076ad0d6e/0x5d1142b832481cba lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.727325:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076ad0d6e/0x5d1142b832481cba lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.727360:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000076ad0d6e/0x5d1142b832481cba lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.727368:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076ad0d6e/0x5d1142b832481cba lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.727376:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076ad0d6e/0x5d1142b832481cba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.727383:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eea400 already unused, calling callback (ffffffffc1649440) 00010000:00010000:3.0:1787823601.727388:0:6687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076ad0d6e/0x5d1142b832481cba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.727398:0:6687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076ad0d6e/0x5d1142b832481cba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.727417:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076ad0d6e/0x5d1142b832481cba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.727438:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076ad0d6e/0x5d1142b832481cba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823601.728641:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79049c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+6:2354:x1874668629830144:12345-192.168.202.35@tcp:1:lhsmtool_posix.0 Request processed in 21483us (23952us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823601.728653:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 32 00000100:00100000:2.0:1787823601.736131:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823601.736425:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629830528 00000100:00100000:3.0:1787823601.736436:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629830528 00000100:00100000:3.0:1787823601.736862:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 83 00000100:00100000:3.0:1787823601.736874:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e93cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+12:10444:x1874668629830528:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787823601.737065:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481cc1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.737093:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481cc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.737109:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481cc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.737416:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481cc8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.737429:0:7893:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481c7b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447b9 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.737438:0:7893:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481cc8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.737503:0:7893:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481c7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447b9 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.737519:0:7893:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481c7b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447b9 expref: 13 pid: 5838 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823601.737536:0:7893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792e80cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7893:1874668651874304:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787823601.737640:0:7893:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7904707180 going to sleep for 11 seconds 00000100:00100000:1.0:1787823601.743316:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823601.743355:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629830656 00000100:00100000:1.0:1787823601.743364:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629830656 00010000:00010000:1.0:1787823601.743408:0:7631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481c7b lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447b9 expref: 14 pid: 5838 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823601.743446:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 45 00000100:00100000:1.0:1787823601.743457:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0efc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:353832f0-fe7b-4d99-975c-a8041babed42+14:2353:x1874668629830656:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787823601.743485:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823601.743495:0:7631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481c7b lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447b9 expref: 14 pid: 5838 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.743510:0:7631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481c7b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447b9 expref: 14 pid: 5838 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.743536:0:7631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e79087c9600) 00010000:00010000:1.0:1787823601.743541:0:7631:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481cc8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.743566:0:7631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481cc8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.743575:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481cc8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.743595:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823601.743656:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0efc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:353832f0-fe7b-4d99-975c-a8041babed42+14:2353:x1874668629830656:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 200us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823601.743664:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 45 00010000:00010000:3.0:1787823601.745302:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481c7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447b9 expref: 13 pid: 5838 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823601.745326:0:7893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792e80cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7893:1874668651874304:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787823601.745350:0:7893:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481cc8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.745360:0:7893:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481cc8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823601.745366:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481cc8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787823601.746208:0:7893:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1787823601.746370:0:7893:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1787823601.746415:0:7893:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1787823601.746633:0:7893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792e80cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7893:1874668651874432:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787823601.746708:0:7893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823601.746753:0:7893:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7904707900 going to sleep for 11 seconds 00000100:00100000:1.0:1787823601.747125:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651874432 00000100:00100000:1.0:1787823601.747134:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651874432 00000100:00100000:1.0:1787823601.747188:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787823601.747197:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7893:x1874668651874432:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787823601.747294:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7893:x1874668651874432:12345-0@lo:1000:mdt00_003.0 Request processed in 98us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823601.747301:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787823601.747380:0:7893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792e80cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7893:1874668651874432:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1787823601.750327:0:7893:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:3.0:1787823601.750437:0:7893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792e80cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7893:1874668651874560:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787823601.751681:0:7893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823601.751713:0:7893:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7904707180 going to sleep for 11 seconds 00000100:00100000:3.0:1787823601.751936:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651874560 00000100:00100000:3.0:1787823601.751945:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651874560 00000100:00100000:3.0:1787823601.754175:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787823601.754193:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7893:x1874668651874560:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787823601.755582:0:7893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792e80cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7893:1874668651874560:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1787823601.755639:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481cc8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823601.755650:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481cc8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823601.755658:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481cc8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823601.755664:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eebc00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823601.755669:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481cc8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823601.755677:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481cc8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823601.755694:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e79087c9600) 00010000:00010000:2.0:1787823601.755697:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787823601.755703:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481cc8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823601.755710:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481cc8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823601.755787:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481bf6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823601.755808:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481bf6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823601.755814:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481bf6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823601.755820:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f3a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823601.755824:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481bf6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823601.755831:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481bf6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823601.755840:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e7917859500) 00010000:00010000:2.0:1787823601.755843:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787823601.755846:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481bf6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823601.755851:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481bf6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823601.755878:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481ccf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823601.755904:0:7893:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b832481c12 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4479d expref: 16 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823601.755915:0:7893:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481ccf lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823601.755958:0:7893:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b832481c12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4479d expref: 16 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823601.756077:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7893:x1874668651874560:12345-0@lo:1000:mdt00_003.0 Request processed in 1889us (4398us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787823601.756090:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1787823601.757881:0:7893:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b832481c12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4479d expref: 16 pid: 7893 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823601.758199:0:7893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792e93e580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7893:1874668651874688:192.168.202.35@tcp:104: 00000100:00100000:2.0:1787823601.758300:0:7893:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a47a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787823601.763188:0:7893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792e93e580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7893:1874668651874688:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787823601.763220:0:7893:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481ccf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823601.765137:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823601.765711:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629830784 00000100:00100000:1.0:1787823601.765722:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629830784 00010000:00010000:1.0:1787823601.765794:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b832481c12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4479d expref: 17 pid: 7893 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823601.765832:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 46 00000100:00100000:1.0:1787823601.765843:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:353832f0-fe7b-4d99-975c-a8041babed42+17:2352:x1874668629830784:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787823601.765869:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823601.765877:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b832481c12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4479d expref: 17 pid: 7893 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.765913:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b832481c12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4479d expref: 17 pid: 7893 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.765937:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b832481c12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4479d expref: 17 pid: 7893 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.765953:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e7917859500) 00010000:00010000:1.0:1787823601.765958:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481ccf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.765967:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481ccf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.766331:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481ccf lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.766370:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787823601.766587:0:7893:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481ccf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.766597:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481ccf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.766610:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481ccf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.766617:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481ccf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.766624:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481ccf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.766629:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823601.766633:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481ccf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.766641:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481ccf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.766651:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e7917859500) 00010000:00010000:0.0:1787823601.766653:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823601.766658:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481ccf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.766664:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481ccf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.766676:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481cc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.766689:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481cc1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.766696:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481cc1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.766701:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eea600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823601.766704:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481cc1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.766710:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481cc1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.766716:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e7917859500) 00010000:00010000:0.0:1787823601.766718:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787823601.766721:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481cc1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.766727:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481cc1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823601.768153:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:353832f0-fe7b-4d99-975c-a8041babed42+16:2352:x1874668629830784:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 2299us (3012us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823601.768168:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 46 00000100:00100000:0.0:1787823601.768799:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e93cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+15:10444:x1874668629830528:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 Request processed in 31924us (32672us total) trans 4294967361 rc 0/0 00000100:00100000:0.0:1787823601.768809:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 83 00000020:00080000:0.0:1787823601.768814:0:7893:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787823601.769111:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787823601.769117:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787823601.769173:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787823601.769179:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787823601.773674:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823601.773754:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629831040 00000100:00100000:1.0:1787823601.773791:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629831040 00000100:00100000:1.0:1787823601.773852:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 20 00000100:00100000:1.0:1787823601.773864:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926245680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+15:10444:x1874668629831040:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787823601.774844:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787823601.774967:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967362 00010000:00010000:1.0:1787823601.775027:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481cd6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.775054:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481cd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.775067:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481cd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.775077:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481cd6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.775084:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481cd6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.775090:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481cd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823601.775112:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787823601.775210:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926245680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+17:10444:x1874668629831040:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 Request processed in 1345us (1546us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1787823601.775219:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 20 00000020:00080000:1.0:1787823601.775224:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787823601.777617:0:7630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787823601.777636:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481cd6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.777668:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f2800 already unused, calling callback (ffffffffc1649440) 00010000:00010000:0.0:1787823601.777673:0:7630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481cd6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.777683:0:7630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481cd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.777703:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e7917859f00) 00010000:00010000:0.0:1787823601.777707:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787823601.777712:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481cd6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.777719:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481cd6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823601.777742:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823601.777755:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823601.777776:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823601.902013:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787823602.079675:0:12001:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787823602.079685:0:12001:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787823602.079721:0:12001:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787823602.079729:0:12001:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787823602.226221:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823602.226849:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629831296 00000100:00100000:1.0:1787823602.226870:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629831296 00000100:00100000:1.0:1787823602.226955:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 84 00000100:00100000:1.0:1787823602.226967:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+17:10454:x1874668629831296:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:1.0:1787823602.227007:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823602.227028:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481cdd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f447d5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.227317:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2600/0x5d1142b832481ce4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.227334:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2600/0x5d1142b832481ce4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.227349:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2600/0x5d1142b832481ce4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787823602.227361:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1787823602.227552:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481cdd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447d5 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.227569:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2600/0x5d1142b832481ce4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447d5 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.227577:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e791767b200) 00010000:00010000:1.0:1787823602.227580:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787823602.227584:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a2f2600, rc 0) 00000100:00100000:1.0:1787823602.227652:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+19:10454:x1874668629831296:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 689us (1443us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1787823602.227660:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 84 00000100:00080000:3.0:1787823602.228708:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787823602.232698:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823602.232778:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629831424 00000100:00100000:0.0:1787823602.232789:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629831424 00000100:00100000:0.0:1787823602.232848:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 85 00000100:00100000:0.0:1787823602.232863:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+19:10454:x1874668629831424:12345-192.168.202.35@tcp:34:lfs.0 00010000:00010000:0.0:1787823602.232955:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481cf2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.232973:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481cf2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.232985:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481cf2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.233017:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832481cf9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.233025:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832481cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.233031:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832481cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.233310:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481d00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.233317:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481d00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.233321:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481d00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787823602.233354:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481d00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.233363:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481cf2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.233366:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481cf2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.233371:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481cf2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.233375:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40f000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823602.233378:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481cf2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.233387:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481cf2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.233397:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e791767b200) 00010000:00010000:0.0:1787823602.233399:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823602.233403:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481cf2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.233560:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481cf2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.233570:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832481cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.233574:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832481cf9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.233578:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832481cf9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.233580:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40e000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823602.233582:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832481cf9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.233586:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832481cf9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.233591:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e791767b900) 00010000:00010000:0.0:1787823602.233592:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823602.233594:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832481cf9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.233605:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832481cf9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.233615:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481d00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.233618:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481d00 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.233622:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481d00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.233625:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40f800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823602.233626:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481d00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.233630:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481d00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.233633:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e791767ba00) 00010000:00010000:0.0:1787823602.233635:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823602.233636:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481d00 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.233639:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481d00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823602.233707:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+19:10454:x1874668629831424:12345-192.168.202.35@tcp:34:lfs.0 Request processed in 848us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823602.233715:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 85 00000100:00100000:2.0:1787823602.279440:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823602.279517:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629831680 00000100:00100000:3.0:1787823602.279527:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629831680 00000100:00100000:3.0:1787823602.279589:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 86 00000100:00100000:3.0:1787823602.279600:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e93d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+19:10457:x1874668629831680:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:3.0:1787823602.279622:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823602.279642:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b832481d07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f447dc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.279727:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481d0e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.279777:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481d0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.279789:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481d0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.279806:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832481d15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.279814:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832481d15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.279821:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832481d15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.280205:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481d1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.280215:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481d1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.280223:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481d1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787823602.280232:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787823602.280320:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481d0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.280328:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481d0e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.280335:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481d0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.280346:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eeaa00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823602.280350:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481d0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.280358:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481d0e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.280370:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e791767b200) 00010000:00010000:3.0:1787823602.280373:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787823602.280377:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481d0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.280383:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481d0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.280395:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832481d15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.280401:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832481d15 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.280407:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832481d15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.280412:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eeac00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823602.280415:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832481d15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.280421:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832481d15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.280438:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e79087c9c00) 00010000:00010000:3.0:1787823602.280440:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787823602.280443:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832481d15 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.280450:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832481d15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.280491:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b832481d07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447dc expref: 22 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.280504:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481d1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447dc expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.280511:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e79087c9d00) 00010000:00010000:3.0:1787823602.280514:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787823602.280516:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7920eea600, rc 0) 00000100:00100000:3.0:1787823602.280588:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e93d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+21:10457:x1874668629831680:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 989us (1158us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1787823602.280596:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 86 00000100:00100000:3.0:1787823602.285241:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823602.285313:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629831808 00000100:00100000:0.0:1787823602.285322:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629831808 00000100:00100000:0.0:1787823602.285386:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 87 00000100:00100000:0.0:1787823602.285395:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+21:10457:x1874668629831808:12345-192.168.202.35@tcp:54:lfs.0 00010000:00010000:0.0:1787823602.285475:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832481d2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.285493:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832481d2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.285506:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832481d2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.285532:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832481d2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.285538:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832481d2a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.285545:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832481d2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.285551:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40e000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823602.285555:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832481d2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.285561:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832481d2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.285573:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e79087c9d00) 00010000:00010000:0.0:1787823602.285576:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787823602.285580:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832481d2a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.285594:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832481d2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823602.285667:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+21:10457:x1874668629831808:12345-192.168.202.35@tcp:54:lfs.0 Request processed in 273us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823602.285674:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 87 00000100:00100000:0.0:1787823602.288526:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823602.288572:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629832064 00000100:00100000:3.0:1787823602.288582:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629832064 00000100:00100000:3.0:1787823602.288643:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 21 00000100:00100000:0.0:1787823602.288650:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:3.0:1787823602.288653:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7925a90450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+21:10457:x1874668629832064:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:0.0:1787823602.288658:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:3.0:1787823602.288914:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7925a90450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+22:10457:x1874668629832064:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 261us (398us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1787823602.288931:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 21 00000100:00100000:2.0:1787823602.334035:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823602.334075:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629832320 00000100:00100000:2.0:1787823602.334084:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629832320 00000100:00100000:2.0:1787823602.334140:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 88 00000100:00100000:2.0:1787823602.334150:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e93c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+22:9987:x1874668629832320:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:2.0:1787823602.334173:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823602.334191:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481d31 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f447e3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.334293:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832481d38 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.334308:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481d1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447dc expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.334318:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832481d38 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.334356:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481d1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447dc expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.334369:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481d1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447dc expref: 23 pid: 5838 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823602.334382:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792e93e580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1874668651874816:192.168.202.35@tcp:104: 00000100:00100000:2.0:1787823602.334464:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a47a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787823602.348360:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823602.348443:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629832448 00000100:00100000:3.0:1787823602.348453:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629832448 00000100:00100000:2.0:1787823602.348714:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792e93e580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1874668651874816:192.168.202.35@tcp:104: 00010000:00010000:2.0:1787823602.348739:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832481d38 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.349105:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481d1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447dc expref: 24 pid: 5838 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823602.349147:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 47 00000100:00100000:3.0:1787823602.349157:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926247480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:353832f0-fe7b-4d99-975c-a8041babed42+24:2352:x1874668629832448:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787823602.349171:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787823602.349178:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481d1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447dc expref: 24 pid: 5838 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.349190:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481d1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447dc expref: 24 pid: 5838 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.349214:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481d1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447dc expref: 24 pid: 5838 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.349228:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e79087c9d00) 00010000:00010000:3.0:1787823602.349233:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832481d38 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.349243:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832481d38 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.349252:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832481d38 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.349290:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787823602.349343:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926247480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:353832f0-fe7b-4d99-975c-a8041babed42+23:2352:x1874668629832448:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 186us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823602.349351:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 47 00010000:00010000:2.0:1787823602.350232:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832481d38 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.350243:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832481d38 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787823602.350262:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787823602.350429:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481d31 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447e3 expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.350446:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832481d38 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447e3 expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.350454:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e79087c9d00) 00010000:00010000:2.0:1787823602.350457:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787823602.350469:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d2a00, rc 0) 00000100:00100000:2.0:1787823602.350512:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e93c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+23:9987:x1874668629832320:12345-192.168.202.35@tcp:101:bash.0 Request processed in 16363us (16487us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1787823602.350520:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 88 00000100:00100000:3.0:1787823602.353517:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823602.354838:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629832704 00000100:00100000:1.0:1787823602.354853:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629832704 00000100:00100000:1.0:1787823602.354928:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 89 00000100:00100000:1.0:1787823602.354939:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+23:9987:x1874668629832704:12345-192.168.202.35@tcp:36:bash.0 00010000:00010000:1.0:1787823602.355387:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b832481d46 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.355411:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b832481d46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.355422:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b832481d46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787823602.355470:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000004:00010000:1.0:1787823602.355496:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e6fb37fe reply state 00000000531a50c8 transno 4294967369 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b832481d46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823602.355505:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1787823602.355558:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000100:00100000:1.0:1787823602.355679:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+27:9987:x1874668629832704:12345-192.168.202.35@tcp:36:bash.0 Request processed in 741us (2170us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1787823602.355686:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 89 00000020:00080000:1.0:1787823602.355691:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1787823602.357920:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b832481d46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.357936:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b832481d46 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.357944:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b832481d46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.357950:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f2e00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823602.357956:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b832481d46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.357964:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b832481d46 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.357990:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e79087c9d00) 00010000:00010000:3.0:1787823602.357993:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787823602.357998:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b832481d46 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.358005:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b832481d46 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823602.358791:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823602.358901:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629832832 00000100:00100000:2.0:1787823602.358912:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629832832 00000100:00100000:2.0:1787823602.358976:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 90 00000100:00100000:2.0:1787823602.358986:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+26:9987:x1874668629832832:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:2.0:1787823602.359010:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823602.359026:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481d4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f447ea expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.359082:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481d4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447ea expref: 27 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.359095:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481d4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447ea expref: 27 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.359112:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e79087c9d00) 00010000:00010000:2.0:1787823602.359116:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787823602.359119:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d2c00, rc 0) 00000100:00100000:2.0:1787823602.359182:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+27:9987:x1874668629832832:12345-192.168.202.35@tcp:101:bash.0 Request processed in 196us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823602.359189:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 90 00000100:00100000:2.0:1787823602.362222:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823602.362487:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629832960 00000100:00100000:3.0:1787823602.362497:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629832960 00000100:00100000:3.0:1787823602.362552:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 33 00000100:00100000:3.0:1787823602.362562:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e93e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:353832f0-fe7b-4d99-975c-a8041babed42+6:9987:x1874668629832960:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:3.0:1787823602.362578:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823602.362598:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076ad0d6e/0x5d1142b832481d54 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f447f1 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787823602.362624:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9005f1, atime: 0x6a9005ef, ctime: 0x6a9005f1, blocks: 0xb 00010000:00010000:3.0:1787823602.362648:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=343s v=(0 0) 00010000:00010000:3.0:1787823602.362652:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787823602.362661:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076ad0d6e/0x5d1142b832481d54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447f1 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.362677:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000076ad0d6e/0x5d1142b832481d54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447f1 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.362700:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7920eea400, rc 0) 00000100:00100000:3.0:1787823602.362793:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e93e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:353832f0-fe7b-4d99-975c-a8041babed42+7:9987:x1874668629832960:12345-192.168.202.35@tcp:101:bash.0 Request processed in 233us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823602.362800:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 33 00000100:00100000:3.0:1787823602.365648:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823602.366947:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629833088 00000100:00100000:0.0:1787823602.366958:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629833088 00002000:00010000:0.0:1787823602.366994:0:6692:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1787823602.366999:0:6692:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8e792e80c000 with x1874668629833088 ext(0->18446744073709551615) 00002000:00010000:0.0:1787823602.367010:0:6692:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e792e80c000. 00000100:00100000:0.0:1787823602.367050:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 1 00000100:00100000:0.0:1787823602.367061:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:353832f0-fe7b-4d99-975c-a8041babed42+7:2353:x1874668629833088:12345-192.168.202.35@tcp:10:bash.0 00002000:00010000:0.0:1787823602.367286:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787823602.367289:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787823601 -> 1787823602 00002000:00010000:0.0:1787823602.367291:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1787823599 -> 1787823599 00002000:00010000:0.0:1787823602.367292:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787823601 -> 1787823602 00002000:00010000:0.0:1787823602.367294:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787823602.367345:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:353832f0-fe7b-4d99-975c-a8041babed42+8:2353:x1874668629833088:12345-192.168.202.35@tcp:10:bash.0 Request processed in 286us (1706us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787823602.367352:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 1 00002000:00010000:0.0:1787823602.367356:0:6692:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1787823602.367371:0:6692:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8e792e80c000 with x1874668629833088 ext(0->18446744073709551615) 00002000:00010000:0.0:1787823602.367376:0:6692:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e792e80c000. 00000100:00100000:2.0:1787823602.453533:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823602.453601:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629833216 00000100:00100000:1.0:1787823602.453610:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629833216 00000100:00100000:1.0:1787823602.453675:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 91 00000100:00100000:1.0:1787823602.453686:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e93cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+27:10472:x1874668629833216:12345-192.168.202.35@tcp:34:lfs.0 00010000:00010000:1.0:1787823602.453818:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481d5b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.453837:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481d5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.453847:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481d5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.454074:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481d62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.454093:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481d62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.454100:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481d62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.454339:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832481d69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.454345:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832481d69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.454350:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832481d69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787823602.454380:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832481d69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.454388:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481d5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.454393:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481d5b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.454398:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481d5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.454515:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f2200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823602.454521:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481d5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.454527:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481d5b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.454543:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e791767b200) 00010000:00010000:2.0:1787823602.454545:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823602.454549:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481d5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.454553:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481d5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.454563:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481d62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.454566:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481d62 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.454569:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481d62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.454572:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823602.454574:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481d62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.454578:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481d62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.454581:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e79228daf00) 00010000:00010000:2.0:1787823602.454583:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823602.454584:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481d62 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.454587:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481d62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.454603:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832481d69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.454607:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832481d69 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.454610:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832481d69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.454613:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d2800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823602.454615:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832481d69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.454618:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832481d69 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.454622:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e79087c9d00) 00010000:00010000:2.0:1787823602.454623:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823602.454625:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832481d69 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.454628:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832481d69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823602.454694:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e93cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+27:10472:x1874668629833216:12345-192.168.202.35@tcp:34:lfs.0 Request processed in 1008us (1229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823602.454702:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 91 00000100:00100000:3.0:1787823602.496025:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823602.496258:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629833472 00000100:00100000:2.0:1787823602.496270:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629833472 00000100:00100000:2.0:1787823602.496334:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 92 00000100:00100000:2.0:1787823602.496361:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+27:10475:x1874668629833472:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:2.0:1787823602.496385:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823602.496550:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832481d70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f447f8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.496615:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481d77 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.496626:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481d77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.496635:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481d77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.496646:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481d7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.496651:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481d7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.496655:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481d7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.497068:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481d85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.497078:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481d85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.497085:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481d85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787823602.497107:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787823602.497199:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481d77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.497206:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481d77 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.497394:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481d77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.497522:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823602.497528:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481d77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.497538:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481d77 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.497552:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e791767b200) 00010000:00010000:2.0:1787823602.497555:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823602.497559:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481d77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.497566:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481d77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.497580:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481d7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.497587:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481d7e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.497604:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481d7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.497610:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823602.497613:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481d7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.497620:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481d7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.497628:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e79228daf00) 00010000:00010000:2.0:1787823602.497631:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823602.497634:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481d7e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.497640:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481d7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.497686:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832481d70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447f8 expref: 30 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.497699:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481d85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447f8 expref: 29 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.497707:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e79087c9d00) 00010000:00010000:2.0:1787823602.497709:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787823602.497711:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d2200, rc 0) 00000100:00100000:2.0:1787823602.498317:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+29:10475:x1874668629833472:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 1953us (2298us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1787823602.498336:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 92 00000100:00100000:3.0:1787823602.502376:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823602.502486:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629833600 00000100:00100000:0.0:1787823602.502497:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629833600 00000100:00100000:0.0:1787823602.502572:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 93 00000100:00100000:0.0:1787823602.502584:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+29:10475:x1874668629833600:12345-192.168.202.35@tcp:54:lfs.0 00010000:00010000:0.0:1787823602.502667:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481d93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.502687:0:7893:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832481d38 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447e3 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.502697:0:7893:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481d93 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.502753:0:7893:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832481d38 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447e3 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.502794:0:7893:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832481d38 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447e3 expref: 29 pid: 5840 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823602.502809:0:7893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7926245680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7893:1874668651874944:192.168.202.35@tcp:104: 00000100:00100000:0.0:1787823602.503404:0:7893:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7903721180 going to sleep for 11 seconds 00000100:00100000:0.0:1787823602.506275:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823602.506360:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629833856 00000100:00100000:2.0:1787823602.506370:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629833856 00000100:00100000:2.0:1787823602.506436:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 22 00000100:00100000:2.0:1787823602.506447:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79262470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+30:5592:x1874668629833856:12345-192.168.202.35@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787823602.506817:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79262470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+31:5592:x1874668629833856:12345-192.168.202.35@tcp:35:ldlm_bl.0 Request processed in 370us (551us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1787823602.506827:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 22 00000100:00100000:1.0:1787823602.508257:0:7893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7926245680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7893:1874668651874944:192.168.202.35@tcp:104: 00010000:00010000:1.0:1787823602.508291:0:7893:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481d93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823602.510187:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823602.511614:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629833984 00000100:00100000:1.0:1787823602.511628:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629833984 00010000:00010000:1.0:1787823602.511678:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832481d38 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447e3 expref: 31 pid: 5840 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823602.511721:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 48 00000100:00100000:1.0:1787823602.511731:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:353832f0-fe7b-4d99-975c-a8041babed42+31:2352:x1874668629833984:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787823602.511756:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823602.511779:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832481d38 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447e3 expref: 31 pid: 5840 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.511794:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832481d38 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447e3 expref: 31 pid: 5840 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.511817:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832481d38 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447e3 expref: 31 pid: 5840 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.511835:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e79087c9d00) 00010000:00010000:1.0:1787823602.511841:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481d93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.511850:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481d93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.512159:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481d93 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.512193:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787823602.512313:0:7893:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481d93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.512322:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481d93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.512360:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481d93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.512368:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481d93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.512374:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481d93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.512380:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40f000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823602.512384:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481d93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.512392:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481d93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823602.512573:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:353832f0-fe7b-4d99-975c-a8041babed42+30:2352:x1874668629833984:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 841us (2393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823602.512582:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 48 00010000:00010000:0.0:1787823602.512621:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e79087c9d00) 00010000:00010000:0.0:1787823602.512626:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787823602.512631:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481d93 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.512638:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832481d93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823602.512682:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+29:10475:x1874668629833600:12345-192.168.202.35@tcp:54:lfs.0 Request processed in 10099us (10320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823602.512690:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 93 00000100:00100000:0.0:1787823602.515345:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823602.515510:0:12014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629834240 00000100:00100000:2.0:1787823602.515521:0:12014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629834240 00000100:00100000:2.0:1787823602.515614:0:12014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 23 00000100:00100000:2.0:1787823602.515627:0:12014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926245680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:353832f0-fe7b-4d99-975c-a8041babed42+29:10475:x1874668629834240:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:2.0:1787823602.515950:0:12014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926245680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:353832f0-fe7b-4d99-975c-a8041babed42+30:10475:x1874668629834240:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 325us (615us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1787823602.515958:0:12014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 23 00000100:00100000:2.0:1787823602.579393:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823602.579615:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629834496 00000100:00100000:3.0:1787823602.579639:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629834496 00000100:00100000:3.0:1787823602.579728:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 94 00000100:00100000:3.0:1787823602.579749:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e93c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+30:10486:x1874668629834496:12345-192.168.202.35@tcp:101:cat.0 00010000:00010000:3.0:1787823602.579810:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823602.579832:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832481d9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f447ff expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.579927:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481da1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.579942:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481da1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.579954:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481da1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.579967:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481da8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.579973:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481da8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.579979:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481da8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.580443:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481daf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.580452:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481daf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.580459:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481daf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787823602.580476:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1787823602.580570:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481da1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.580579:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481da1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.580586:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481da1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.580592:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eea600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823602.580596:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481da1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.580604:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481da1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.580616:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e791767b200) 00010000:00010000:3.0:1787823602.580619:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787823602.580622:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481da1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.580628:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481da1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.580640:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481da8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.580647:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481da8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.580662:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481da8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.580667:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eeaa00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823602.580670:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481da8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.580677:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481da8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.580685:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e79087c9800) 00010000:00010000:3.0:1787823602.580687:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787823602.580690:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481da8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.580695:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481da8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.580736:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832481d9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447ff expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.580813:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481daf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447ff expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.580821:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e79087c9d00) 00010000:00010000:3.0:1787823602.580823:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787823602.580825:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7920eebc00, rc 0) 00000100:00100000:3.0:1787823602.581261:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e93c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+32:10486:x1874668629834496:12345-192.168.202.35@tcp:101:cat.0 Request processed in 1522us (1879us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1787823602.581279:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 94 00000100:00100000:3.0:1787823602.589055:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823602.589219:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629834752 00000100:00100000:2.0:1787823602.589230:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629834752 00000100:00100000:2.0:1787823602.589325:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 24 00000100:00100000:2.0:1787823602.589336:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ac852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+32:10486:x1874668629834752:12345-192.168.202.35@tcp:35:cat.0 00000100:00100000:2.0:1787823602.589560:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ac852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+33:10486:x1874668629834752:12345-192.168.202.35@tcp:35:cat.0 Request processed in 225us (514us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1787823602.589569:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 24 00000100:00100000:0.0:1787823602.616579:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823602.616832:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629835008 00000100:00100000:2.0:1787823602.617106:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629835008 00000100:00100000:2.0:1787823602.617218:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 95 00000100:00100000:2.0:1787823602.617229:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ad51680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+33:10487:x1874668629835008:12345-192.168.202.35@tcp:36:rm.0 00010000:00010000:2.0:1787823602.617287:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787823602.617313:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481daf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447ff expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.617353:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481d85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447f8 expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.617367:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481d4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447ea expref: 31 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.617377:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e79087c9d00) 00010000:00010000:2.0:1787823602.617388:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787823602.617409:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481dbd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.617422:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481dbd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.617432:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481dbd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.617446:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481dc4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.617453:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481dc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.617459:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481dc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.617919:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481dcb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.617930:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481dcb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.617937:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481dcb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787823602.619243:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1787823602.619256:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 343473496674ns, next at 344473493906ns, rc = 0 00010000:00010000:2.0:1787823602.619328:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3c00/0x5d1142b832481dd2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.619340:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3c00/0x5d1142b832481dd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.619349:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3c00/0x5d1142b832481dd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.619356:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3c00/0x5d1142b832481dd2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.619362:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3c00/0x5d1142b832481dd2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.619368:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3c00/0x5d1142b832481dd2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.619440:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787823602.619521:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481dcb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.619538:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481dcb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.619545:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481dcb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.619551:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823602.619556:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481dcb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.619563:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481dcb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.619575:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e79228da000) 00010000:00010000:2.0:1787823602.619577:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787823602.619582:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481dcb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.619587:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481dcb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.619605:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481dbd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.619611:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481dbd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.619617:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481dbd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.619622:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823602.619630:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481dbd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.619637:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481dbd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.619644:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e791767b200) 00010000:00010000:2.0:1787823602.619646:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823602.619649:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481dbd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.619655:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481dbd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787823602.619664:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000456cb4a4 reply state 00000000d505a0de transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481dc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823602.619674:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787823602.619795:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ad51680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+32:10487:x1874668629835008:12345-192.168.202.35@tcp:36:rm.0 Request processed in 2563us (3223us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1787823602.619804:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 95 00010000:00010000:0.0:1787823602.621266:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481dc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.621292:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481dc4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.621299:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481dc4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.621304:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823602.621308:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481dc4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.621316:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481dc4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.621331:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e79228daf00) 00010000:00010000:0.0:1787823602.621333:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823602.621338:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481dc4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.621344:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481dc4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.624662:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787823602.624678:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3c00/0x5d1142b832481dd2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.624690:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3c00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:1.0:1787823602.624694:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3c00/0x5d1142b832481dd2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.624706:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3c00/0x5d1142b832481dd2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.624726:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e79228da000) 00010000:00010000:1.0:1787823602.624730:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787823602.624735:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3c00/0x5d1142b832481dd2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.624752:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3c00/0x5d1142b832481dd2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.624803:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823602.624805:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823602.624807:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823602.669805:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823602.670145:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629835264 00000100:00100000:2.0:1787823602.670156:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629835264 00000100:00100000:2.0:1787823602.670211:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 96 00000100:00100000:2.0:1787823602.670222:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ad52d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+31:10493:x1874668629835264:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:2.0:1787823602.670245:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823602.670266:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481dd9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44806 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.670421:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481de0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.670475:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481de0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.670489:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481de0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.670507:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481de7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.670515:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481de7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.670522:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481de7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787823602.671733:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1787823602.672253:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481dee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.672268:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481dee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.672279:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481dee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.672322:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481de0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.672329:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481de0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.672336:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481de0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.672350:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823602.672355:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481de0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.672363:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481de0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.672375:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e791767b200) 00010000:00010000:2.0:1787823602.672378:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823602.672384:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481de0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.672390:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481de0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787823602.672404:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fe1f47ef reply state 0000000073ecf6f7 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481de7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823602.672413:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787823602.672444:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481dd9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44806 expref: 34 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.672459:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481dee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44806 expref: 33 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.672610:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e79228dab00) 00010000:00010000:2.0:1787823602.672613:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787823602.672615:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d2200, rc 0) 00000100:00100000:2.0:1787823602.672829:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ad52d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+34:10493:x1874668629835264:12345-192.168.202.35@tcp:101:bash.0 Request processed in 2606us (3098us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1787823602.672845:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 96 00000100:00100000:2.0:1787823602.677832:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823602.678282:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629835392 00000100:00100000:0.0:1787823602.678294:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629835392 00000100:00100000:0.0:1787823602.678380:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 34 00000100:00100000:0.0:1787823602.678393:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e93ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+7:2355:x1874668629835392:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:0.0:1787823602.678413:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823602.678436:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000884ef705/0x5d1142b832481dfc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f4480d expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787823602.678493:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787823602.678515:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=343s v=(0 0) 00010000:00010000:0.0:1787823602.678520:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787823602.678529:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000884ef705/0x5d1142b832481dfc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4480d expref: 8 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.678549:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000884ef705/0x5d1142b832481dfc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4480d expref: 8 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823602.678562:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40f400, rc 0) 00000100:00100000:0.0:1787823602.678621:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e93ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+8:2355:x1874668629835392:12345-192.168.202.35@tcp:101:bash.0 Request processed in 231us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823602.678628:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 34 00000100:00080000:2.0:1787823602.679356:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787823602.679490:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481de7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.679501:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481de7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.679508:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481de7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.679514:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d2c00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823602.679519:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481de7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.679528:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481de7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.679544:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e79228da400) 00010000:00010000:3.0:1787823602.679547:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787823602.679551:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481de7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.679557:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481de7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823602.682346:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823602.682453:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629835520 00000100:00100000:1.0:1787823602.682500:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629835520 00000100:00100000:1.0:1787823602.682574:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 35 00000100:00100000:1.0:1787823602.682584:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+8:10493:x1874668629835520:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:1.0:1787823602.682604:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823602.682625:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043213e5b/0x5d1142b832481e03 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44814 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.682665:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000884ef705/0x5d1142b832481dfc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4480d expref: 9 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.682675:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787823602.682680:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787823602.682686:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043213e5b/0x5d1142b832481e03 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44814 expref: 9 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.682718:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000884ef705/0x5d1142b832481dfc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4480d expref: 9 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.682732:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000884ef705/0x5d1142b832481dfc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4480d expref: 9 pid: 6687 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823602.682966:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a0ee580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6686:1874668651875072:192.168.202.35@tcp:104: 00000100:00100000:1.0:1787823602.683061:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79189a2480 going to sleep for 11 seconds 00000100:00100000:0.0:1787823602.685901:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823602.685985:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629835648 00000100:00100000:3.0:1787823602.685993:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629835648 00010000:00010000:3.0:1787823602.686037:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000884ef705/0x5d1142b832481dfc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4480d expref: 10 pid: 6687 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823602.686107:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 49 00000100:00100000:3.0:1787823602.686119:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7909a20c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:353832f0-fe7b-4d99-975c-a8041babed42+10:2352:x1874668629835648:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787823602.686135:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787823602.686156:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000884ef705/0x5d1142b832481dfc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4480d expref: 10 pid: 6687 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.686171:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000884ef705/0x5d1142b832481dfc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4480d expref: 10 pid: 6687 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.686196:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787823602.686201:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787823602.686209:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000043213e5b/0x5d1142b832481e03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44814 expref: 10 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.686220:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043213e5b/0x5d1142b832481e03 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44814 expref: 10 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.686256:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000043213e5b/0x5d1142b832481e03 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44814 expref: 10 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823602.686270:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec4cb40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5823:1874668651875200:192.168.202.35@tcp:105: 00000100:00100000:3.0:1787823602.686350:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7904707480 going to sleep for 11 seconds 00010000:00010000:1.0:1787823602.687321:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000884ef705/0x5d1142b832481dfc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4480d expref: 10 pid: 6687 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823602.687360:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a0ee580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6686:1874668651875072:192.168.202.35@tcp:104: 00010000:00010000:1.0:1787823602.687389:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043213e5b/0x5d1142b832481e03 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44814 expref: 9 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.687401:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a2f2200, rc 0) 00000100:00100000:1.0:1787823602.687459:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+9:10493:x1874668629835520:12345-192.168.202.35@tcp:101:bash.0 Request processed in 4876us (5126us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823602.687476:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 35 00000100:00100000:0.0:1787823602.691139:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823602.691234:0:12014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629835904 00000100:00100000:2.0:1787823602.691245:0:12014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629835904 00000100:00100000:2.0:1787823602.691316:0:12014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 25 00000100:00100000:2.0:1787823602.691328:0:12014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ad52580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:353832f0-fe7b-4d99-975c-a8041babed42+33:10493:x1874668629835904:12345-192.168.202.35@tcp:35:bash.0 00000100:00100000:2.0:1787823602.692092:0:12014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ad52580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:353832f0-fe7b-4d99-975c-a8041babed42+34:10493:x1874668629835904:12345-192.168.202.35@tcp:35:bash.0 Request processed in 760us (958us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1787823602.692102:0:12014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 25 00000100:00100000:3.0:1787823602.692820:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec4cb40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5823:1874668651875200:192.168.202.35@tcp:105: 00010000:00010000:3.0:1787823602.692869:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787823602.692919:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7909a20c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:353832f0-fe7b-4d99-975c-a8041babed42+8:2352:x1874668629835648:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 6801us (7027us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823602.692930:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 49 00000100:00100000:0.0:1787823602.812644:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823602.812717:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629836032 00000100:00100000:1.0:1787823602.812726:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629836032 00000100:00100000:1.0:1787823602.812826:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 97 00000100:00100000:1.0:1787823602.812833:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922b8bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+34:10509:x1874668629836032:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:1.0:1787823602.813027:0:7893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823602.813052:0:7893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b832481e0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f4481b expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.813128:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481e11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.813144:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481e11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.813154:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481e11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787823602.813210:0:7893:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1787823602.813227:0:7893:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787823602.813254:0:7893:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481e11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.813280:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b832481e0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4481b expref: 36 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.813294:0:7893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481e11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4481b expref: 35 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.813301:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e791767b200) 00010000:00010000:1.0:1787823602.813303:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787823602.813306:0:7893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a2f3600, rc 0) 00000100:00100000:1.0:1787823602.813401:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922b8bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+35:10509:x1874668629836032:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 569us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823602.813409:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 97 00000100:00100000:2.0:1787823602.824312:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823602.824381:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629836288 00000100:00100000:3.0:1787823602.824390:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629836288 00000100:00100000:3.0:1787823602.824450:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 98 00000100:00100000:3.0:1787823602.824461:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e93d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+35:10509:x1874668629836288:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:3.0:1787823602.824481:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823602.824501:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832481e18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44822 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.824600:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481e1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.824612:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481e1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.824620:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481e1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787823602.824627:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787823602.824799:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832481e18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44822 expref: 38 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.824819:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481e1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44822 expref: 37 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.824828:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e79228dab00) 00010000:00010000:3.0:1787823602.824851:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787823602.824856:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7920eeaa00, rc 0) 00000100:00100000:3.0:1787823602.824926:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e93d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+37:10509:x1874668629836288:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 466us (621us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1787823602.824933:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 98 00000100:00100000:0.0:1787823602.828811:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823602.829133:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629836544 00000100:00100000:2.0:1787823602.829144:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629836544 00000100:00100000:2.0:1787823602.829205:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 99 00000100:00100000:2.0:1787823602.829216:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922b88b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+37:10509:x1874668629836544:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:2.0:1787823602.829242:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823602.829265:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3c00/0x5d1142b832481e2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44829 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.829390:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481e34 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.829406:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481e34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.829417:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481e34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787823602.829443:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787823602.829700:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3c00/0x5d1142b832481e2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44829 expref: 40 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.829720:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481e34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44829 expref: 39 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.829729:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e79228dab00) 00010000:00010000:2.0:1787823602.829731:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787823602.829735:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d3800, rc 0) 00000100:00100000:2.0:1787823602.829845:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922b88b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+39:10509:x1874668629836544:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 630us (1086us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1787823602.830404:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 99 00000100:00100000:0.0:1787823602.835055:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823602.835139:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629836672 00000100:00100000:1.0:1787823602.835148:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629836672 00000100:00100000:1.0:1787823602.835222:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 6 00000100:00100000:1.0:1787823602.835232:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922b88780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:353832f0-fe7b-4d99-975c-a8041babed42+39:2353:x1874668629836672:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787823602.835250:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823602.835273:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481e1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44822 expref: 39 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.835291:0:7631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e79228dab00) 00010000:00010000:1.0:1787823602.835297:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823602.835354:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922b88780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:353832f0-fe7b-4d99-975c-a8041babed42+38:2353:x1874668629836672:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 122us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823602.835379:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 6 00000100:00100000:3.0:1787823602.846472:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823602.846683:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629836800 00000100:00100000:1.0:1787823602.846693:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629836800 00000100:00100000:1.0:1787823602.846795:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 36 00000100:00100000:1.0:1787823602.846806:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:353832f0-fe7b-4d99-975c-a8041babed42+8:2352:x1874668629836800:12345-192.168.202.35@tcp:1:lfs.0 00010000:00010000:1.0:1787823602.846854:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bed48ed2/0x5d1142b832481e42 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.846875:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043213e5b/0x5d1142b832481e03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44814 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.846894:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787823602.846899:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787823602.846904:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bed48ed2/0x5d1142b832481e42 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.846941:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000043213e5b/0x5d1142b832481e03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44814 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.846955:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000043213e5b/0x5d1142b832481e03 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44814 expref: 8 pid: 6686 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823602.846971:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a0ee580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6688:1874668651875328:192.168.202.35@tcp:104: 00000100:00100000:1.0:1787823602.847087:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79189a2480 going to sleep for 11 seconds 00000100:00100000:1.0:1787823602.850733:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a0ee580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6688:1874668651875328:192.168.202.35@tcp:104: 00010000:00010000:1.0:1787823602.850827:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bed48ed2/0x5d1142b832481e42 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823602.851357:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823602.851436:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629836928 00000100:00100000:2.0:1787823602.851445:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629836928 00002000:00100000:2.0:1787823602.851506:0:6693:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8e7926247480 x1874668629836928/t0(0) o4->353832f0-fe7b-4d99-975c-a8041babed42@192.168.202.35@tcp:223/0 lens 504/0 e 0 to 0 dl 1787823613 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787823602.851513:0:6693:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8e7926247480 with x1874668629836928 ext(0->8) 00010000:00010000:2.0:1787823602.851519:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000043213e5b/0x5d1142b832481e03 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44814 expref: 9 pid: 6686 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.851530:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000043213e5b/0x5d1142b832481e03 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44814 expref: 9 pid: 6686 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787823602.851535:0:6693:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e7926247480 00000100:00100000:2.0:1787823602.851564:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 1 00000100:00100000:2.0:1787823602.851579:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:353832f0-fe7b-4d99-975c-a8041babed42+9:2352:x1874668629836928:12345-192.168.202.35@tcp:4:lfs.0 00000100:00100000:2.0:1787823602.852684:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:353832f0-fe7b-4d99-975c-a8041babed42+11:2352:x1874668629836928:12345-192.168.202.35@tcp:4:lfs.0 Request processed in 1097us (1321us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787823602.852692:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 1 00002000:00100000:2.0:1787823602.852700:0:6693:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8e7926247480 x1874668629836928/t4294967302(0) o4->353832f0-fe7b-4d99-975c-a8041babed42@192.168.202.35@tcp:223/0 lens 504/448 e 0 to 0 dl 1787823613 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787823602.852707:0:6693:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8e7926247480 with x1874668629836928 ext(0->8) 00010000:00010000:2.0:1787823602.852712:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000043213e5b/0x5d1142b832481e03 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44814 expref: 11 pid: 6686 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.852726:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000043213e5b/0x5d1142b832481e03 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44814 expref: 11 pid: 6686 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787823602.852734:0:6693:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e7926247480 00000100:00100000:2.0:1787823602.856870:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823602.860688:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629837056 00000100:00100000:1.0:1787823602.860706:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629837056 00010000:00010000:1.0:1787823602.860816:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000043213e5b/0x5d1142b832481e03 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44814 expref: 11 pid: 6686 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823602.860868:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 50 00000100:00100000:1.0:1787823602.861224:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e93de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:353832f0-fe7b-4d99-975c-a8041babed42+11:2353:x1874668629837056:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787823602.861242:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787823602.861261:0:5825:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787823602.861264:0:5825:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787823603 00002000:00010000:1.0:1787823602.861266:0:5825:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787823603 00002000:00010000:1.0:1787823602.861268:0:5825:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787823603 00010000:00010000:1.0:1787823602.861275:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000043213e5b/0x5d1142b832481e03 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44814 expref: 11 pid: 6686 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.861291:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000043213e5b/0x5d1142b832481e03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44814 expref: 11 pid: 6686 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.861314:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043213e5b/0x5d1142b832481e03 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44814 expref: 11 pid: 6686 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.861331:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787823602.861336:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787823602.861354:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bed48ed2/0x5d1142b832481e42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.861365:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bed48ed2/0x5d1142b832481e42 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.861401:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823602.861479:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e93de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:353832f0-fe7b-4d99-975c-a8041babed42+10:2353:x1874668629837056:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 600us (4618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823602.861487:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 50 00010000:00010000:3.0:1787823602.862638:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bed48ed2/0x5d1142b832481e42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.862654:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bed48ed2/0x5d1142b832481e42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.862683:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bed48ed2/0x5d1142b832481e42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.862691:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bed48ed2/0x5d1142b832481e42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.862699:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bed48ed2/0x5d1142b832481e42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.862707:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f2e00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:3.0:1787823602.862711:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bed48ed2/0x5d1142b832481e42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.862720:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bed48ed2/0x5d1142b832481e42 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.862952:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bed48ed2/0x5d1142b832481e42 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.862962:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bed48ed2/0x5d1142b832481e42 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823602.863148:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:353832f0-fe7b-4d99-975c-a8041babed42+9:2352:x1874668629836800:12345-192.168.202.35@tcp:1:lfs.0 Request processed in 16340us (16693us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823602.863160:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 36 00000100:00100000:2.0:1787823602.867398:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823602.867475:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629837312 00000100:00100000:3.0:1787823602.867487:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629837312 00000100:00100000:3.0:1787823602.867552:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 26 00000100:00100000:3.0:1787823602.867566:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7925a92050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+38:10509:x1874668629837312:12345-192.168.202.35@tcp:35:lfs.0 00000004:00010000:3.0:1787823602.867637:0:5842:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481e34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44829 expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787823602.868042:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1787823602.868090:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:3.0:1787823602.868439:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00010000:00010000:3.0:1787823602.868494:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481e49 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.868511:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481dee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44806 expref: 42 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.868521:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481e49 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.868566:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481dee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44806 expref: 42 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.868582:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481dee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44806 expref: 42 pid: 5838 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823602.868599:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792e80e1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5842:1874668651875456:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787823602.868705:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79047076c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787823602.874534:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792e80e1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5842:1874668651875456:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787823602.874640:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481e49 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823602.875076:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823602.876007:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629837440 00000100:00100000:3.0:1787823602.876020:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629837440 00010000:00010000:3.0:1787823602.876122:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481dee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44806 expref: 43 pid: 5838 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823602.876209:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 51 00000100:00100000:3.0:1787823602.876219:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e93c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:353832f0-fe7b-4d99-975c-a8041babed42+43:2353:x1874668629837440:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787823602.876236:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787823602.876242:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481dee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44806 expref: 43 pid: 5838 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.876255:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481dee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44806 expref: 43 pid: 5838 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.876294:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481dee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44806 expref: 43 pid: 5838 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.876311:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e79228dab00) 00010000:00010000:3.0:1787823602.876317:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481e49 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.876325:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481e49 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.876333:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481e49 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.876368:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787823602.876440:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e93c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:353832f0-fe7b-4d99-975c-a8041babed42+42:2353:x1874668629837440:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 222us (1365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823602.876449:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 51 00010000:00010000:2.0:1787823602.877478:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481e49 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.877491:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481e49 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787823602.877624:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:2.0:1787823602.878233:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1787823602.878356:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792e93f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1874668651875584:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787823602.878414:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823602.878466:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79012ed840 going to sleep for 11 seconds 00000100:00100000:3.0:1787823602.878755:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651875584 00000100:00100000:3.0:1787823602.879120:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651875584 00000100:00100000:3.0:1787823602.879218:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787823602.879229:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5842:x1874668651875584:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787823602.879330:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5842:x1874668651875584:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 103us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823602.879339:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787823602.879407:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792e93f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1874668651875584:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787823602.880088:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1787823602.880166:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792e80a940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1874668651875712:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787823602.880216:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823602.880635:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79012ed840 going to sleep for 11 seconds 00000100:00100000:0.0:1787823602.880672:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651875712 00000100:00100000:0.0:1787823602.880678:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651875712 00000100:00100000:0.0:1787823602.880710:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787823602.880718:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e93f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5842:x1874668651875712:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787823602.881164:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e93f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5842:x1874668651875712:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 444us (944us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787823602.881172:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787823602.881300:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792e80a940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1874668651875712:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787823602.881370:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1787823602.881406:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481e49 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.881416:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481e49 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.881425:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481e49 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.881432:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eea600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823602.881437:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481e49 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.881444:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481e49 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.881472:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e79228dab00) 00010000:00010000:2.0:1787823602.881476:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787823602.881480:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481e49 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823602.881487:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481e49 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787823602.881665:0:5842:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787823602.881999:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1787823602.882010:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 343736250415ns, next at 344736248551ns, rc = 0 00000001:00080000:2.0:1787823602.882016:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:2.0:1787823602.882061:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e79228dab00) 00010000:00010000:2.0:1787823602.882064:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787823602.882073:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481e34 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44829 expref: 46 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823602.882178:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7925a92050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+45:10509:x1874668629837312:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 14616us (14790us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1787823602.882188:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 26 00000020:00080000:2.0:1787823602.882193:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787823602.887348:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823602.887431:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629837568 00000100:00100000:3.0:1787823602.887442:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629837568 00000100:00100000:3.0:1787823602.887502:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 100 00000100:00100000:3.0:1787823602.887512:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79262470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+45:10509:x1874668629837568:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:3.0:1787823602.887555:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823602.887578:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832481e50 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44830 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.887640:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832481e50 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44830 expref: 46 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.887655:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832481e50 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44830 expref: 46 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823602.887675:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e79087c9800) 00010000:00010000:3.0:1787823602.887678:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787823602.887682:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7920eeac00, rc 0) 00000100:00100000:3.0:1787823602.887755:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79262470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+46:10509:x1874668629837568:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 244us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823602.887806:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 100 00000100:00100000:0.0:1787823602.892064:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823602.892243:0:12014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629837824 00000100:00100000:2.0:1787823602.892255:0:12014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629837824 00000100:00100000:2.0:1787823602.892359:0:12014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 27 00000100:00100000:2.0:1787823602.892372:0:12014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:353832f0-fe7b-4d99-975c-a8041babed42+46:10509:x1874668629837824:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:2.0:1787823602.892686:0:12014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:353832f0-fe7b-4d99-975c-a8041babed42+47:10509:x1874668629837824:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 315us (632us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1787823602.892695:0:12014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 27 00010000:00010000:3.0:1787823602.927168:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823602.979903:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823602.980002:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629837952 00000100:00100000:1.0:1787823602.980013:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629837952 00000100:00100000:1.0:1787823602.980193:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 101 00000100:00100000:1.0:1787823602.980204:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+47:10519:x1874668629837952:12345-192.168.202.35@tcp:34:lfs.0 00010000:00010000:1.0:1787823602.980291:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481e57 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.980309:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481e57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.980322:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481e57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.980341:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481e5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.980348:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.980355:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.980682:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481e65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.980692:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481e65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.980699:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481e65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787823602.980754:0:7893:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481e65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.980815:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481e57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.980822:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481e57 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.980829:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481e57 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.980836:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f2200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823602.980841:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481e57 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.980849:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481e57 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.980864:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e791767b200) 00010000:00010000:1.0:1787823602.980868:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823602.980873:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481e57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.980887:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481e57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.980902:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.980907:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481e5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.980912:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481e5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.980918:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f2a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823602.980921:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481e5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.980927:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481e5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.980934:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e7917859900) 00010000:00010000:1.0:1787823602.980937:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823602.980940:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481e5e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.980945:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481e5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.980960:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481e65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.980966:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481e65 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.980978:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481e65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.980983:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f3a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823602.980986:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481e65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.980993:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481e65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.981001:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e79087c9800) 00010000:00010000:1.0:1787823602.981004:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823602.981006:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481e65 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823602.981012:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481e65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823602.981092:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+47:10519:x1874668629837952:12345-192.168.202.35@tcp:34:lfs.0 Request processed in 888us (1199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823602.981100:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 101 00000100:00100000:3.0:1787823603.019819:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823603.020202:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629838208 00000100:00100000:2.0:1787823603.020214:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629838208 00000100:00100000:2.0:1787823603.020277:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 102 00000100:00100000:2.0:1787823603.020288:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+47:10522:x1874668629838208:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:2.0:1787823603.020308:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823603.020344:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481e6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44837 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.020424:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481e73 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.020440:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481e73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.020451:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481e73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.020465:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481e7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.020472:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.020479:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.020731:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481e81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.020752:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481e81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.020987:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481e81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787823603.021001:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787823603.021234:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481e73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.021257:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481e73 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.021264:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481e73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.021271:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d2c00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823603.021276:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481e73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.021283:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481e73 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.021296:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e791767b200) 00010000:00010000:2.0:1787823603.021299:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823603.021303:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481e73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.021309:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832481e73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.021322:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.021327:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481e7a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.021333:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481e7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.021338:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823603.021347:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481e7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.021352:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481e7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.021361:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e79228dab00) 00010000:00010000:2.0:1787823603.021364:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823603.021367:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481e7a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.021372:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481e7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.021422:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481e6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44837 expref: 50 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.021438:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481e81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44837 expref: 49 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.021446:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e79087c9800) 00010000:00010000:2.0:1787823603.021449:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787823603.021451:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d3a00, rc 0) 00000100:00100000:2.0:1787823603.021704:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+49:10522:x1874668629838208:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 1417us (1951us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1787823603.021713:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 102 00000100:00100000:0.0:1787823603.028228:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823603.028358:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629838336 00000100:00100000:2.0:1787823603.028370:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629838336 00000100:00100000:2.0:1787823603.028498:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 103 00000100:00100000:2.0:1787823603.028510:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+49:10522:x1874668629838336:12345-192.168.202.35@tcp:54:lfs.0 00010000:00010000:2.0:1787823603.028623:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481e8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.028642:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481e8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.028654:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481e8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.028680:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481e8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.028686:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481e8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.028692:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481e8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.028698:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d2200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823603.028702:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481e8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.028708:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481e8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.028720:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e79087c9800) 00010000:00010000:2.0:1787823603.028723:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787823603.028729:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481e8f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.028751:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481e8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823603.029166:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+49:10522:x1874668629838336:12345-192.168.202.35@tcp:54:lfs.0 Request processed in 656us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823603.029174:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 103 00000100:00100000:3.0:1787823603.032723:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823603.032860:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629838592 00000100:00100000:2.0:1787823603.032875:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629838592 00000100:00100000:2.0:1787823603.032940:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 28 00000100:00100000:2.0:1787823603.032950:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+49:10522:x1874668629838592:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:2.0:1787823603.034068:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+50:10522:x1874668629838592:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 1110us (1347us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1787823603.034083:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 28 00000100:00100000:3.0:1787823603.160104:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823603.161171:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629838848 00000100:00100000:2.0:1787823603.161184:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629838848 00000100:00100000:2.0:1787823603.161299:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 104 00000100:00100000:2.0:1787823603.161310:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+50:10532:x1874668629838848:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:2.0:1787823603.161335:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823603.161338:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787823603.161367:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481e11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4481b expref: 50 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.161388:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e791767b200) 00010000:00010000:2.0:1787823603.161393:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787823603.161406:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481e96 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f4483e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.161526:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481e9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.161553:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481e9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.161564:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481e9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787823603.161576:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787823603.161699:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481e96 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4483e expref: 52 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.161713:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481e9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4483e expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.161721:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e79087c9800) 00010000:00010000:2.0:1787823603.161724:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787823603.161726:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d3800, rc 0) 00000100:00100000:2.0:1787823603.161851:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+51:10532:x1874668629838848:12345-192.168.202.35@tcp:101:bash.0 Request processed in 542us (1833us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1787823603.161867:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 104 00000100:00100000:0.0:1787823603.166863:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823603.167360:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629839104 00000100:00100000:1.0:1787823603.167371:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629839104 00000100:00100000:1.0:1787823603.167578:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 105 00000100:00100000:1.0:1787823603.167591:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+51:10532:x1874668629839104:12345-192.168.202.35@tcp:36:bash.0 00010000:00010000:1.0:1787823603.167682:0:7893:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787823603.167712:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832481e9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4483e expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.168011:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481e81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44837 expref: 50 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.168268:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e79087c9800) 00010000:00010000:1.0:1787823603.168274:0:7893:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787823603.168656:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481eab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.168672:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481eab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.168683:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481eab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787823603.168753:0:7893:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967394 00000004:00010000:1.0:1787823603.169225:0:7893:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000008960be4 reply state 00000000ec43883e transno 4294967395 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481eab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823603.169238:0:7893:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787823603.169400:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+52:10532:x1874668629839104:12345-192.168.202.35@tcp:36:bash.0 Request processed in 1809us (2555us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1787823603.169408:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 105 00000020:00080000:1.0:1787823603.169414:0:7893:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787823603.178037:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823603.178097:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629839232 00000100:00100000:2.0:1787823603.178107:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629839232 00000100:00100000:2.0:1787823603.178159:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 106 00000100:00100000:2.0:1787823603.178167:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+52:10532:x1874668629839232:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:2.0:1787823603.178189:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823603.178207:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481eb2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44845 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.178308:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481eb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.178321:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481eab lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.178328:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481eb9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.178343:0:5840:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481eab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.178353:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481eb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823603.178931:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481eab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823603.178942:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481eab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823603.178949:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481eab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823603.178956:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f2a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823603.178959:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481eab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823603.178967:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481eab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823603.178982:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e79087c9800) 00010000:00010000:0.0:1787823603.178985:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823603.178987:0:3292:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481eb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823603.178995:0:3292:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823603.179002:0:3292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481eb9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823603.179040:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481eab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823603.179056:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481eab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823603.179083:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823603.179090:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787823603.179128:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787823603.179134:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787823603.179152:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823603.179180:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481eb2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44845 expref: 53 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823603.179193:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481eb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44845 expref: 52 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823603.179201:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e79087c9800) 00010000:00010000:0.0:1787823603.179203:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787823603.179205:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d3400, rc 0) 00000100:00100000:0.0:1787823603.180303:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+52:10532:x1874668629839232:12345-192.168.202.35@tcp:101:bash.0 Request processed in 2126us (2280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823603.180315:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 106 00000100:00100000:2.0:1787823603.184637:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823603.185000:0:12014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629839488 00000100:00100000:0.0:1787823603.185011:0:12014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629839488 00000100:00100000:0.0:1787823603.185214:0:12014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 29 00000100:00100000:0.0:1787823603.185239:0:12014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926245680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:353832f0-fe7b-4d99-975c-a8041babed42+52:10532:x1874668629839488:12345-192.168.202.35@tcp:35:bash.0 00000100:00100000:0.0:1787823603.185486:0:12014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926245680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:353832f0-fe7b-4d99-975c-a8041babed42+53:10532:x1874668629839488:12345-192.168.202.35@tcp:35:bash.0 Request processed in 249us (858us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1787823603.185495:0:12014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 29 00000100:00100000:1.0:1787823603.285504:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823603.285747:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629839616 00000100:00100000:2.0:1787823603.285801:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629839616 00000100:00100000:2.0:1787823603.285884:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 107 00000100:00100000:2.0:1787823603.285895:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+53:10538:x1874668629839616:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:2.0:1787823603.285924:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823603.285945:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3c00/0x5d1142b832481ec0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f4484c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.286031:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832481ec7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.286047:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832481ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.286077:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832481ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787823603.286144:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787823603.286148:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787823603.286174:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832481ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.286200:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3c00/0x5d1142b832481ec0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4484c expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.286221:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832481ec7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4484c expref: 54 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.286228:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e791767b200) 00010000:00010000:2.0:1787823603.286231:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787823603.286234:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d2a00, rc 0) 00000100:00100000:2.0:1787823603.286310:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+54:10538:x1874668629839616:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 416us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823603.286318:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 107 00000100:00100000:2.0:1787823603.290747:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823603.291321:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629839744 00000100:00100000:3.0:1787823603.291333:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629839744 00000100:00100000:3.0:1787823603.291399:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 108 00000100:00100000:3.0:1787823603.291410:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ac852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+54:10538:x1874668629839744:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:3.0:1787823603.291429:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823603.291449:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481ece lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44853 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.291535:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481ed5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.291550:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481ed5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.291561:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481ed5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.291574:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481edc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.291582:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481edc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.291588:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481edc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.291691:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031c00/0x5d1142b832481ee3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.291700:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031c00/0x5d1142b832481ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.291707:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031c00/0x5d1142b832481ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787823603.291755:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787823603.292329:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787823603.292681:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031c00/0x5d1142b832481ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.292697:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031c00/0x5d1142b832481ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.292722:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481ed5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.292729:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481ed5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.293253:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481ed5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.293259:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eeaa00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823603.293262:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481ed5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.293270:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481ed5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.293285:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e791767b200) 00010000:00010000:1.0:1787823603.293288:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823603.293292:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481ed5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.293298:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832481ed5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.293314:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481edc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.293320:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481edc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.293326:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481edc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.293338:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eebc00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823603.293341:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481edc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.293347:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481edc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.293355:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e79087c9500) 00010000:00010000:1.0:1787823603.293357:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823603.293360:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481edc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.293366:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832481edc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.293405:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832481ece lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44853 expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.293418:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031c00/0x5d1142b832481ee3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44853 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.293425:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e79087c9800) 00010000:00010000:1.0:1787823603.293427:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787823603.293430:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7900031c00, rc 0) 00000100:00100000:1.0:1787823603.293613:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ac852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+55:10538:x1874668629839744:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 2202us (2884us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823603.293622:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 108 00000100:00100000:2.0:1787823603.298988:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823603.299144:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823603.299228:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629840128 00000100:00100000:0.0:1787823603.299243:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629840128 00000100:00100000:0.0:1787823603.299316:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 7 00000100:00100000:0.0:1787823603.299326:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a49e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:353832f0-fe7b-4d99-975c-a8041babed42+55:2352:x1874668629840128:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787823603.299343:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787823603.299369:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031c00/0x5d1142b832481ee3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44853 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823603.299389:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e79087c9800) 00010000:00010000:0.0:1787823603.299395:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787823603.299491:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a49e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:353832f0-fe7b-4d99-975c-a8041babed42+54:2352:x1874668629840128:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 166us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823603.299499:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 7 00000100:00100000:3.0:1787823603.299631:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629840000 00000100:00100000:3.0:1787823603.299636:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629840000 00000100:00100000:3.0:1787823603.299689:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 109 00000100:00100000:3.0:1787823603.299696:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ad52580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+54:10538:x1874668629840000:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:3.0:1787823603.299713:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823603.299728:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030400/0x5d1142b832481eea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f4485a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.299897:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030200/0x5d1142b832481ef1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.299912:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481eb9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44845 expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.299920:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030200/0x5d1142b832481ef1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.299950:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481eb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44845 expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.299963:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481eb9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44845 expref: 55 pid: 5840 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823603.299976:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7926194f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1874668651875840:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787823603.300272:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79047076c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787823603.303707:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823603.303809:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629840256 00000100:00100000:1.0:1787823603.303832:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629840256 00010000:00010000:1.0:1787823603.304223:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481eb9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44845 expref: 56 pid: 5840 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823603.304266:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 52 00000100:00100000:1.0:1787823603.304277:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:353832f0-fe7b-4d99-975c-a8041babed42+56:2353:x1874668629840256:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787823603.304292:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823603.304299:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481eb9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44845 expref: 56 pid: 5840 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.304313:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481eb9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44845 expref: 56 pid: 5840 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.304335:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e79087c9800) 00010000:00010000:1.0:1787823603.304340:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030200/0x5d1142b832481ef1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.304349:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030200/0x5d1142b832481ef1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.304357:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030200/0x5d1142b832481ef1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.304374:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823603.304430:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:353832f0-fe7b-4d99-975c-a8041babed42+56:2353:x1874668629840256:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 155us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823603.304438:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 52 00010000:00010000:3.0:1787823603.306327:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481eb9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44845 expref: 55 pid: 5840 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823603.306354:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7926194f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1874668651875840:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787823603.306380:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030200/0x5d1142b832481ef1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.306408:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030200/0x5d1142b832481ef1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.306414:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030200/0x5d1142b832481ef1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787823603.306436:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787823603.306680:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030400/0x5d1142b832481eea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4485a expref: 56 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.306699:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030200/0x5d1142b832481ef1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4485a expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.306708:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e79087c9800) 00010000:00010000:3.0:1787823603.306711:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787823603.306715:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7900030200, rc 0) 00000100:00100000:3.0:1787823603.307206:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ad52580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+55:10538:x1874668629840000:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 7507us (8453us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1787823603.307216:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 109 00000100:00100000:0.0:1787823603.311240:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823603.311329:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629840512 00000100:00100000:3.0:1787823603.311339:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629840512 00000100:00100000:3.0:1787823603.311438:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 8 00000100:00100000:3.0:1787823603.311450:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:353832f0-fe7b-4d99-975c-a8041babed42+55:10538:x1874668629840512:12345-192.168.202.35@tcp:103:lfs.0 00010000:00010000:3.0:1787823603.311477:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787823603.311503:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832481e50 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44830 expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.311540:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e79087c9800) 00010000:00010000:3.0:1787823603.311547:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787823603.311605:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:353832f0-fe7b-4d99-975c-a8041babed42+54:10538:x1874668629840512:12345-192.168.202.35@tcp:103:lfs.0 Request processed in 157us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823603.311614:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 8 00000100:00100000:2.0:1787823603.314548:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823603.314646:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629840640 00000100:00100000:0.0:1787823603.314656:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629840640 00000100:00100000:0.0:1787823603.314799:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 110 00000100:00100000:0.0:1787823603.314810:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a49d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+54:10538:x1874668629840640:12345-192.168.202.35@tcp:58:lfs.0 00010000:00010000:0.0:1787823603.314932:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b832481eff lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823603.314971:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b832481eff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823603.314984:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b832481eff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787823603.315498:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1787823603.315634:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a49d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+54:10538:x1874668629840640:12345-192.168.202.35@tcp:58:lfs.0 Request processed in 825us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823603.315643:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 110 00000100:00100000:2.0:1787823603.318447:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823603.318616:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629840768 00000100:00100000:1.0:1787823603.318625:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629840768 00000100:00100000:1.0:1787823603.318700:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 111 00000100:00100000:1.0:1787823603.318711:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a49fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+54:10538:x1874668629840768:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:1.0:1787823603.318742:0:7893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823603.319143:0:7893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481f06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44861 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.319204:0:7893:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b832481eff lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.319216:0:7893:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481f06 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44861 expref: 55 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.319236:0:7893:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b832481eff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.319252:0:7893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481f06 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44861 expref: 55 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.319266:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e79087c9800) 00010000:00010000:1.0:1787823603.319269:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787823603.319273:0:7893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481f06 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44861 expref: 55 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.319282:0:7893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a2f2800, rc 0) 00000100:00100000:1.0:1787823603.319379:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a49fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+55:10538:x1874668629840768:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 670us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823603.319386:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 111 00000001:00080000:1.0:1787823603.816215:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1787823603.816263:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:1.0:1787823603.816272:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000040:00080000:1.0:1787823603.818007:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787823603.818016:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787823603.818062:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1787823603.818069:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787823603.818205:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a0ec000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1874668651875968:192.168.202.35@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787823603.818316:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79189a26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787823603.823190:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823603.823427:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629840896 00000100:00100000:3.0:1787823603.823438:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629840896 00000100:00100000:3.0:1787823603.823513:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 112 00000100:00100000:3.0:1787823603.823525:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a49cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+56:10539:x1874668629840896:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787823603.823562:0:5838:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787823603.823670:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a49cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+56:10539:x1874668629840896:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 Request processed in 146us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823603.823678:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 112 00000100:00100000:1.0:1787823603.826576:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a0ec000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1874668651875968:192.168.202.35@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787823603.834361:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823603.834462:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629841024 00000100:00100000:3.0:1787823603.834472:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629841024 00000100:00100000:3.0:1787823603.834536:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 113 00000100:00100000:3.0:1787823603.834547:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+55:10539:x1874668629841024:12345-192.168.202.35@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787823603.834619:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030400/0x5d1142b832481f0d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.834638:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030400/0x5d1142b832481f0d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.834650:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030400/0x5d1142b832481f0d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.834744:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031c00/0x5d1142b832481f14 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.834754:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031c00/0x5d1142b832481f14 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.834803:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031c00/0x5d1142b832481f14 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.834842:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c200/0x5d1142b832481f1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.834851:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c200/0x5d1142b832481f1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.835037:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c200/0x5d1142b832481f1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787823603.835255:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787823603.835267:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787823603.835284:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c200/0x5d1142b832481f1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.835297:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030400/0x5d1142b832481f0d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.835304:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030400/0x5d1142b832481f0d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.835310:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030400/0x5d1142b832481f0d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.835316:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7900030400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823603.835321:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030400/0x5d1142b832481f0d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.835328:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030400/0x5d1142b832481f0d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.835340:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e7917859800) 00010000:00010000:2.0:1787823603.835342:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823603.835346:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030400/0x5d1142b832481f0d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.835352:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030400/0x5d1142b832481f0d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.835365:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031c00/0x5d1142b832481f14 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.835370:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031c00/0x5d1142b832481f14 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.835385:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031c00/0x5d1142b832481f14 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.835389:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7900031c00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823603.835392:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031c00/0x5d1142b832481f14 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.835399:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031c00/0x5d1142b832481f14 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.835407:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8e79087c9200) 00010000:00010000:2.0:1787823603.835409:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823603.835412:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031c00/0x5d1142b832481f14 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.835417:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031c00/0x5d1142b832481f14 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.835433:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c200/0x5d1142b832481f1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.835439:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c200/0x5d1142b832481f1b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.835455:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c200/0x5d1142b832481f1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.835461:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26c200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823603.835463:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c200/0x5d1142b832481f1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.835478:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c200/0x5d1142b832481f1b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.835486:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e79087c9800) 00010000:00010000:2.0:1787823603.835488:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823603.835491:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c200/0x5d1142b832481f1b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.835497:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c200/0x5d1142b832481f1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823603.835584:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+55:10539:x1874668629841024:12345-192.168.202.35@tcp:34:lhsmtool_posix.0 Request processed in 1036us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823603.835592:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 113 00000100:00100000:2.0:1787823603.839067:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823603.839203:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629841280 00000100:00100000:3.0:1787823603.839213:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629841280 00000100:00100000:3.0:1787823603.839277:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 114 00000100:00100000:3.0:1787823603.839287:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+55:10539:x1874668629841280:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787823603.839308:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823603.839326:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832481f22 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44868 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.839426:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832481f29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.839442:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832481f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.839479:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832481f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787823603.839492:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787823603.839587:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832481f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.839595:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832481f29 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.839601:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832481f29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.839607:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26d000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823603.839612:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832481f29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.839619:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832481f29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.839633:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e79087c9800) 00010000:00010000:3.0:1787823603.839636:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787823603.839641:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832481f29 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.839648:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832481f29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.839693:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832481f22 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44868 expref: 57 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.839716:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e7917859800) 00010000:00010000:3.0:1787823603.839719:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787823603.839723:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832481f22 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44868 expref: 57 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.839745:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a26ce00, rc 0) 00000100:00100000:3.0:1787823603.839838:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+56:10539:x1874668629841280:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 552us (790us total) trans 4294967398 rc 301/301 00000100:00100000:3.0:1787823603.839845:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 114 00000100:00100000:3.0:1787823603.846994:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823603.847972:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629841408 00000100:00100000:1.0:1787823603.847983:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629841408 00000100:00100000:1.0:1787823603.848053:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 115 00000100:00100000:1.0:1787823603.848064:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926194f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+56:10539:x1874668629841408:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787823603.848107:0:7893:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787823603.848227:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926194f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+56:10539:x1874668629841408:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 Request processed in 164us (1245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823603.848235:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 115 00000100:00100000:1.0:1787823603.853273:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823603.853494:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629841664 00000100:00100000:3.0:1787823603.853505:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629841664 00000100:00100000:3.0:1787823603.853568:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 116 00000100:00100000:3.0:1787823603.853579:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+56:10539:x1874668629841664:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787823603.853600:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823603.853603:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787823603.853632:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832481ec7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4484c expref: 56 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.853653:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e791767b200) 00010000:00010000:3.0:1787823603.853658:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787823603.853673:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c000/0x5d1142b832481f37 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f4486f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787823603.854159:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1787823603.854377:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d400/0x5d1142b832481f3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.854390:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d400/0x5d1142b832481f3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.854400:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d400/0x5d1142b832481f3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.854458:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c000/0x5d1142b832481f37 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4486f expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.854475:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d400/0x5d1142b832481f3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4486f expref: 57 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.854483:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e79087c9700) 00010000:00010000:3.0:1787823603.854485:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787823603.854488:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a26d400, rc 0) 00000100:00100000:3.0:1787823603.854549:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+57:10539:x1874668629841664:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 972us (1289us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1787823603.854557:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 116 00000100:00100000:3.0:1787823603.858025:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823603.858184:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629841920 00000100:00100000:1.0:1787823603.858195:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629841920 00000100:00100000:1.0:1787823603.858264:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 117 00000100:00100000:1.0:1787823603.858274:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926197840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+57:10539:x1874668629841920:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787823603.858340:0:7893:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823603.858369:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d400/0x5d1142b832481f3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4486f expref: 57 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.858423:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e79087c9700) 00010000:00010000:1.0:1787823603.858435:0:7893:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787823603.858459:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481f4c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.858473:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481f4c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.858483:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481f4c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.858556:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481f53 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xe5cddfb9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.858564:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481f53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe5cddfb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.858571:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481f53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe5cddfb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.858648:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481f4c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.858655:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481f4c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.858661:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481f4c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.858667:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f2200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823603.858671:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481f4c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.858687:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481f4c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.858696:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e791767b200) 00010000:00010000:1.0:1787823603.858698:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823603.858702:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481f4c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.858709:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481f4c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.858720:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481f53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe5cddfb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.858743:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481f53 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe5cddfb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.858749:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481f53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe5cddfb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.858754:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f3600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823603.859256:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481f53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe5cddfb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.859267:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481f53 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe5cddfb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.859277:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xe5cddfb9 (ffff8e7917859700) 00010000:00010000:1.0:1787823603.859280:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823603.859283:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481f53 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe5cddfb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.859301:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481f53 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe5cddfb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823603.859409:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926197840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+56:10539:x1874668629841920:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 Request processed in 1134us (1392us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787823603.859417:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 117 00000100:00100000:0.0:1787823603.879723:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823603.879878:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629842048 00000100:00100000:2.0:1787823603.879889:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629842048 00000100:00100000:2.0:1787823603.879953:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 118 00000100:00100000:2.0:1787823603.879965:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+56:10539:x1874668629842048:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787823603.879987:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823603.880013:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481f5a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44876 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.880054:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481f61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.880069:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481f61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.880100:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481f61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.880192:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481f5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44876 expref: 58 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.880211:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481f61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44876 expref: 57 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823603.880219:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e79228dad00) 00010000:00010000:2.0:1787823603.880222:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787823603.880226:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d3400, rc 0) 00000100:00100000:2.0:1787823603.880291:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+57:10539:x1874668629842048:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 329us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823603.880299:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 118 00000100:00100000:0.0:1787823603.883592:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823603.883707:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629842304 00000100:00100000:1.0:1787823603.883716:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629842304 00000100:00100000:1.0:1787823603.883830:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 119 00000100:00100000:1.0:1787823603.883841:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939dc1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+57:10539:x1874668629842304:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787823603.883942:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481f68 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.883962:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481f68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.883974:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481f68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787823603.884222:0:7893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:1.0:1787823603.884232:0:7893:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 344738472948ns, next at 345738470045ns, rc = 0 00000004:00010000:1.0:1787823603.884319:0:7893:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051fbca4d reply state 0000000031729a84 transno 4294967400 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481f68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823603.884329:0:7893:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787823603.884424:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939dc1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+59:10539:x1874668629842304:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 Request processed in 584us (842us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1787823603.884432:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 119 00010000:00010000:3.0:1787823603.886640:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481f68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.886660:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481f68 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.886667:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481f68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.886692:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f3600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823603.886696:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481f68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.886704:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481f68 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.886723:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e79228dad00) 00010000:00010000:3.0:1787823603.886737:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787823603.886743:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481f68 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.886749:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481f68 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823603.887128:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823603.887836:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629842432 00000100:00100000:3.0:1787823603.887847:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629842432 00000100:00100000:3.0:1787823603.887994:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 120 00000100:00100000:3.0:1787823603.888004:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79360b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+58:10539:x1874668629842432:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787823603.888029:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823603.888047:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c000/0x5d1142b832481f6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f4487d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.888107:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c000/0x5d1142b832481f6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4487d expref: 59 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.888120:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c000/0x5d1142b832481f6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4487d expref: 59 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.888156:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e79228dad00) 00010000:00010000:3.0:1787823603.888159:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787823603.888162:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a26c000, rc 0) 00000100:00100000:3.0:1787823603.888245:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79360b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+59:10539:x1874668629842432:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 242us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823603.888252:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 120 00000100:00100000:2.0:1787823603.891301:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823603.891381:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629842560 00000100:00100000:1.0:1787823603.891391:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629842560 00000100:00100000:1.0:1787823603.891470:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 37 00000100:00100000:1.0:1787823603.891481:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+8:2354:x1874668629842560:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787823603.891826:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+9:2354:x1874668629842560:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 Request processed in 346us (535us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787823603.891836:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 37 00000100:00080000:2.0:1787823603.892376:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787823603.900698:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823603.901565:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629842816 00000100:00100000:2.0:1787823603.901576:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629842816 00000100:00100000:2.0:1787823603.901644:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 30 00000100:00100000:2.0:1787823603.901655:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+59:10539:x1874668629842816:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787823603.902534:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+60:10539:x1874668629842816:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 Request processed in 875us (1840us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1787823603.902544:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 30 00000100:00100000:3.0:1787823603.906066:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823603.908340:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629843072 00000100:00100000:1.0:1787823603.908358:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629843072 00000100:00100000:1.0:1787823603.908440:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 121 00000100:00100000:1.0:1787823603.908460:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79261970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+60:10539:x1874668629843072:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787823603.908594:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79261970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+60:10539:x1874668629843072:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 Request processed in 143us (2539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823603.908602:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 121 00000100:00100000:2.0:1787823603.919535:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823603.919646:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629843200 00000100:00100000:3.0:1787823603.919660:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629843200 00000100:00100000:3.0:1787823603.919723:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 122 00000100:00100000:3.0:1787823603.919744:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+60:10539:x1874668629843200:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787823603.919801:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823603.919825:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832481f76 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44884 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.919915:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832481f7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.919937:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832481f7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.919949:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832481f7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787823603.919984:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787823603.920002:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832481f7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.920046:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832481f76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44884 expref: 62 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.920065:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832481f7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44884 expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.920074:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e79228dad00) 00010000:00010000:3.0:1787823603.920077:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787823603.920081:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a26d000, rc 0) 00000100:00100000:3.0:1787823603.920138:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+61:10539:x1874668629843200:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 397us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823603.920146:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 122 00000100:00100000:0.0:1787823603.927417:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823603.927562:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629843328 00000100:00100000:3.0:1787823603.927573:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629843328 00000100:00100000:3.0:1787823603.927641:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 38 00000100:00100000:3.0:1787823603.927651:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:353832f0-fe7b-4d99-975c-a8041babed42+9:2352:x1874668629843328:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787823603.927669:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823603.927693:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074b8b276/0x5d1142b832481f84 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f4488b expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787823603.927719:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9005f4, blocks: 0x1 00010000:00010000:3.0:1787823603.927750:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=344s v=(0 0) 00010000:00010000:3.0:1787823603.927754:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787823603.928363:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074b8b276/0x5d1142b832481f84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4488b expref: 10 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.928409:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000074b8b276/0x5d1142b832481f84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4488b expref: 10 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.928425:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a26da00, rc 0) 00000100:00100000:0.0:1787823603.938968:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:353832f0-fe7b-4d99-975c-a8041babed42+10:2352:x1874668629843328:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 11300us (11543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823603.938982:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 38 00010000:00010000:0.0:1787823603.946442:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823603.949710:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823603.949865:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629843584 00000100:00100000:1.0:1787823603.949875:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629843584 00000100:00100000:1.0:1787823603.949935:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 123 00000100:00100000:1.0:1787823603.949945:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4cad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+61:10539:x1874668629843584:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787823603.950055:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4cad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+61:10539:x1874668629843584:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 Request processed in 104us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823603.950063:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 123 00000100:00100000:2.0:1787823603.955239:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823603.955346:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629843712 00000100:00100000:0.0:1787823603.955356:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629843712 00000100:00100000:0.0:1787823603.955412:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 39 00000100:00100000:0.0:1787823603.955422:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a03cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+10:10539:x1874668629843712:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787823603.955450:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823603.955471:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d1569e9/0x5d1142b832481f8b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44892 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823603.955515:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000074b8b276/0x5d1142b832481f84 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4488b expref: 11 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823603.955524:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787823603.955530:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787823603.955535:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d1569e9/0x5d1142b832481f8b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44892 expref: 11 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823603.955572:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000074b8b276/0x5d1142b832481f84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4488b expref: 11 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823603.955586:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000074b8b276/0x5d1142b832481f84 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4488b expref: 11 pid: 6688 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823603.955603:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4c9a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6687:1874668651876096:192.168.202.35@tcp:104: 00000100:00100000:0.0:1787823603.955720:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7902a93e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787823603.963485:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4c9a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6687:1874668651876096:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787823603.963535:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006d1569e9/0x5d1142b832481f8b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44892 expref: 11 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823603.963561:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40f000, rc 0) 00000100:00100000:3.0:1787823603.963640:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a03cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+11:10539:x1874668629843712:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 8219us (8413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823603.963651:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 39 00000100:00100000:2.0:1787823603.963894:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823603.964027:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629843840 00000100:00100000:1.0:1787823603.964035:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629843840 00010000:00010000:1.0:1787823603.964078:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000074b8b276/0x5d1142b832481f84 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4488b expref: 11 pid: 6688 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823603.964130:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 53 00000100:00100000:1.0:1787823603.964137:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79037f3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:353832f0-fe7b-4d99-975c-a8041babed42+11:2353:x1874668629843840:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787823603.964148:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823603.964165:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000074b8b276/0x5d1142b832481f84 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4488b expref: 11 pid: 6688 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.964175:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000074b8b276/0x5d1142b832481f84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4488b expref: 11 pid: 6688 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.964194:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074b8b276/0x5d1142b832481f84 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4488b expref: 11 pid: 6688 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.964208:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787823603.964211:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787823603.964218:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006d1569e9/0x5d1142b832481f8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44892 expref: 10 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.964225:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d1569e9/0x5d1142b832481f8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44892 expref: 10 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823603.964249:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006d1569e9/0x5d1142b832481f8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44892 expref: 10 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823603.964258:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a0efc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5825:1874668651876224:192.168.202.35@tcp:105: 00000100:00100000:1.0:1787823603.964317:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908c23780 going to sleep for 11 seconds 00000100:00100000:1.0:1787823603.969326:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a0efc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5825:1874668651876224:192.168.202.35@tcp:105: 00010000:00010000:1.0:1787823603.969361:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823603.969429:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79037f3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:353832f0-fe7b-4d99-975c-a8041babed42+10:2353:x1874668629843840:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 5290us (5536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823603.969442:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 53 00000100:00100000:3.0:1787823603.970317:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823603.970407:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629843968 00000100:00100000:2.0:1787823603.970417:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629843968 00002000:00100000:2.0:1787823603.970480:0:6691:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8e7926197480 x1874668629843968/t0(0) o4->353832f0-fe7b-4d99-975c-a8041babed42@192.168.202.35@tcp:224/0 lens 504/0 e 0 to 0 dl 1787823614 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787823603.970492:0:6691:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8e7926197480 with x1874668629843968 ext(0->12) 00002000:00010000:2.0:1787823603.970498:0:6691:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e7926197480 00000100:00100000:2.0:1787823603.970531:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 2 00000100:00100000:2.0:1787823603.970541:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:353832f0-fe7b-4d99-975c-a8041babed42+10:2352:x1874668629843968:12345-192.168.202.35@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787823603.971108:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:353832f0-fe7b-4d99-975c-a8041babed42+12:2352:x1874668629843968:12345-192.168.202.35@tcp:4:lhsmtool_posix.0 Request processed in 565us (792us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787823603.971117:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 2 00002000:00100000:2.0:1787823603.971125:0:6691:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8e7926197480 x1874668629843968/t4294967308(0) o4->353832f0-fe7b-4d99-975c-a8041babed42@192.168.202.35@tcp:224/0 lens 504/448 e 0 to 0 dl 1787823614 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787823603.971135:0:6691:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8e7926197480 with x1874668629843968 ext(0->12) 00002000:00010000:2.0:1787823603.971138:0:6691:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e7926197480 00000100:00100000:1.0:1787823603.975151:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823603.975258:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629844096 00000100:00100000:3.0:1787823603.975268:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629844096 00000100:00100000:3.0:1787823603.975379:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 124 00000100:00100000:3.0:1787823603.975391:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+61:10539:x1874668629844096:12345-192.168.202.35@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787823604.012736:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967396 is committed 00000020:00080000:1.0:1787823604.012791:0:5860:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:1.0:1787823604.012802:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1787823604.012806:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:1.0:1787823604.012835:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967401 is committed 00000004:00080000:1.0:1787823604.012850:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1787823604.012886:0:5860:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e79362df300 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1787823604.012891:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e790522fc00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e79362df480 00000020:00080000:1.0:1787823604.012895:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e790522f600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e79052ad400 00000004:00080000:1.0:1787823604.012913:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1787823604.012948:0:5860:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e7904707900 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1787823604.012951:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e793a4f8b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e7904707c00 00000020:00080000:1.0:1787823604.012954:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e793a4f8000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e791005c800 00000100:00100000:1.0:1787823604.013160:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a0eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651876352:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787823604.013233:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823604.013301:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a0ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651876480:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787823604.013321:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823604.013335:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787823604.013354:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922b88780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651876608:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787823604.013380:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823604.013422:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651876352 00000100:00100000:1.0:1787823604.013431:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651876352 00000100:00100000:1.0:1787823604.013632:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651876480 00000100:00100000:1.0:1787823604.013637:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651876480 00000100:00100000:1.0:1787823604.013647:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651876608 00000100:00100000:1.0:1787823604.013649:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651876608 00000100:00100000:1.0:1787823604.013666:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787823604.013674:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e93de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1874668651876352:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787823604.013699:0:6688:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:1.0:1787823604.013735:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043213e5b/0x5d1142b832481f92 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.013781:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000076ad0d6e/0x5d1142b832481d54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447f1 expref: 11 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.013793:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787823604.013797:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787823604.013802:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043213e5b/0x5d1142b832481f92 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.013832:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000076ad0d6e/0x5d1142b832481d54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447f1 expref: 11 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.013847:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000076ad0d6e/0x5d1142b832481d54 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447f1 expref: 11 pid: 6688 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823604.013873:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a76da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6688:1874668651876736:192.168.202.35@tcp:104: 00000100:00100000:1.0:1787823604.013931:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908c23cc0 going to sleep for 11 seconds 00000100:00080000:1.0:1787823604.013950:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787823604.013954:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:0.0:1787823604.014279:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1787823604.014687:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1787823604.014891:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+15:10539:x1874668629844096:12345-192.168.202.35@tcp:44:lhsmtool_posix.0 Request processed in 39499us (39747us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823604.014901:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 124 00000100:00100000:0.0:1787823604.017877:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823604.017914:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629844224 00000100:00100000:0.0:1787823604.017923:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629844224 00010000:00010000:0.0:1787823604.017967:0:7631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000076ad0d6e/0x5d1142b832481d54 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447f1 expref: 12 pid: 6688 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823604.018003:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 54 00000100:00100000:0.0:1787823604.018027:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4c9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:353832f0-fe7b-4d99-975c-a8041babed42+12:2353:x1874668629844224:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787823604.018045:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787823604.018051:0:7631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000076ad0d6e/0x5d1142b832481d54 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447f1 expref: 12 pid: 6688 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.018067:0:7631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000076ad0d6e/0x5d1142b832481d54 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447f1 expref: 12 pid: 6688 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.018095:0:7631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787823604.018099:0:7631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787823604.018105:0:7631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000043213e5b/0x5d1142b832481f92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.018115:0:7631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043213e5b/0x5d1142b832481f92 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.018136:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787823604.018184:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4c9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:353832f0-fe7b-4d99-975c-a8041babed42+12:2353:x1874668629844224:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 159us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823604.018192:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 54 00010000:00010000:3.0:1787823604.019591:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076ad0d6e/0x5d1142b832481d54 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447f1 expref: 11 pid: 6688 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823604.019640:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a76da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6688:1874668651876736:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787823604.019666:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000043213e5b/0x5d1142b832481f92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823604.019679:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000043213e5b/0x5d1142b832481f92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823604.019688:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043213e5b/0x5d1142b832481f92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823604.019700:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043213e5b/0x5d1142b832481f92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823604.019708:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043213e5b/0x5d1142b832481f92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823604.019749:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787823604.020608:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787823604.020618:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043213e5b/0x5d1142b832481f92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.020630:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f2200 already unused, calling callback (ffffffffc1649440) 00010000:00010000:0.0:1787823604.020636:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043213e5b/0x5d1142b832481f92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.020655:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043213e5b/0x5d1142b832481f92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.020679:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043213e5b/0x5d1142b832481f92 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.020687:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043213e5b/0x5d1142b832481f92 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.020709:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823604.020712:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823604.020713:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823604.023298:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823604.023370:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e93de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3306:x1874668651876352:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9693us (10133us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787823604.023382:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787823604.023412:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629844352 00000100:00100000:3.0:1787823604.023420:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629844352 00000100:00100000:3.0:1787823604.023480:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787823604.023489:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e93c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1874668651876480:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787823604.023705:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787823604.023709:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787823604 00002000:00010000:3.0:1787823604.023711:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787823604.023713:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787823604 -> 1787823604 00002000:00010000:3.0:1787823604.023715:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787823604.023795:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e93c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3307:x1874668651876480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 307us (10472us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787823604.023802:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787823604.023815:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787823604.023823:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a49e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651876608:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787823604.023841:0:6688:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:3.0:1787823604.023866:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9005f3, atime: 0x6a9005f3, ctime: 0x6a9005f3, blocks: 0xb 00010000:00010000:3.0:1787823604.023884:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b1de29d/0x5d1142b832481f99 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823604.023900:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=344s v=(0 0) 00010000:00010000:3.0:1787823604.023904:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787823604.023911:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b1de29d/0x5d1142b832481f99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823604.023926:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b1de29d/0x5d1142b832481f99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823604.023936:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b1de29d/0x5d1142b832481f99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823604.023954:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b1de29d/0x5d1142b832481f99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823604.023970:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787823604.024470:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a49e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1874668651876608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 646us (11087us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787823604.024476:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787823604.024497:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 43 00000100:00100000:3.0:1787823604.024506:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:353832f0-fe7b-4d99-975c-a8041babed42+11:2354:x1874668629844352:12345-192.168.202.35@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787823604.028105:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1787823604.028120:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:2.0:1787823604.028142:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e792e80de00, transno 4294967301 00000004:00080000:2.0:1787823604.028161:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:2.0:1787823604.028180:0:3307:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8e7922b88780 x1874668651876608/t4294967304(4294967304) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787823620 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1787823604.028193:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e7922b88780/2, rc 0, transno 4294967304 00000100:00100000:2.0:1787823604.028199:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922b88780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651876608:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1787823604.028215:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e793a0ede00/2, rc 0, transno 4294967310 00000100:00100000:2.0:1787823604.028233:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a0ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651876480:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1787823604.029024:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e793a0eda40/2, rc 0, transno 4294967309 00000100:00100000:1.0:1787823604.029035:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a0eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651876352:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1787823604.029061:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787823604.029071:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b1de29d/0x5d1142b832481f99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.029085:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26ce00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:1.0:1787823604.029090:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b1de29d/0x5d1142b832481f99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.029103:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b1de29d/0x5d1142b832481f99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.029126:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b1de29d/0x5d1142b832481f99 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.029135:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b1de29d/0x5d1142b832481f99 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.029156:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823604.029165:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823604.029167:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823604.052564:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:353832f0-fe7b-4d99-975c-a8041babed42+11:2354:x1874668629844352:12345-192.168.202.35@tcp:16:lhsmtool_posix.0 Request processed in 28045us (29265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823604.052578:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 43 00000001:00080000:1.0:1787823604.053824:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:1.0:1787823604.053842:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:1.0:1787823604.053850:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:1.0:1787823604.053862:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:1.0:1787823604.055199:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823604.055556:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629844608 00000100:00100000:2.0:1787823604.055566:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629844608 00000100:00100000:0.0:1787823604.055790:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 125 00000100:00100000:0.0:1787823604.055802:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+15:10539:x1874668629844608:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787823604.056007:0:7893:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787823604.056035:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832481f7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44884 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.056057:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e79228dad00) 00010000:00010000:0.0:1787823604.056062:0:7893:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787823604.056092:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481fa0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.056107:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.056136:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787823604.056401:0:7893:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000fb4f80f reply state 000000001fdccb68 transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823604.056410:0:7893:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787823604.056578:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+16:10539:x1874668629844608:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 Request processed in 778us (1388us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1787823604.056585:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 125 00000100:00100000:3.0:1787823604.059161:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823604.059246:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629844736 00000100:00100000:2.0:1787823604.059256:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629844736 00000100:00100000:2.0:1787823604.059319:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 44 00000100:00100000:2.0:1787823604.059329:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79261961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+6:2353:x1874668629844736:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787823604.059582:0:6686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787823604.059586:0:6686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1787823604 -> 1787823603 00002000:00010000:2.0:1787823604.059588:0:6686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787823603 00002000:00010000:2.0:1787823604.059591:0:6686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787823604 -> 1787823603 00002000:00010000:2.0:1787823604.059594:0:6686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787823604.059652:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79261961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+7:2353:x1874668629844736:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 Request processed in 323us (500us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787823604.059660:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 44 00010000:00010000:0.0:1787823604.061139:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.061156:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481fa0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.061165:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481fa0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.061172:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40f800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823604.061177:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481fa0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.061184:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481fa0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.061202:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e79228dad00) 00010000:00010000:0.0:1787823604.061205:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823604.061211:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481fa0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.061240:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832481fa0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787823604.061669:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787823604.063057:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823604.063209:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629844992 00000100:00100000:0.0:1787823604.063219:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629844992 00000100:00100000:0.0:1787823604.063279:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 126 00000100:00100000:0.0:1787823604.063289:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a03e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+15:10539:x1874668629844992:12345-192.168.202.35@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787823604.063361:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481fa7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.063378:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481f61 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44876 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.063387:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481fa7 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.063422:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481f61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44876 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.063437:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481f61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44876 expref: 15 pid: 5840 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823604.063463:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793f9bda40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1874668651876864:192.168.202.35@tcp:104: 00000100:00100000:0.0:1787823604.063555:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7902a93b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787823604.067236:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823604.067464:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793f9bda40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1874668651876864:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787823604.067493:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481fa7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823604.067615:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629845120 00000100:00100000:1.0:1787823604.067622:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629845120 00010000:00010000:1.0:1787823604.067656:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481f61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44876 expref: 16 pid: 5840 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823604.067691:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 55 00000100:00100000:1.0:1787823604.067700:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:353832f0-fe7b-4d99-975c-a8041babed42+16:2353:x1874668629845120:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787823604.067713:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823604.067720:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481f61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44876 expref: 16 pid: 5840 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.067742:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481f61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44876 expref: 16 pid: 5840 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.067793:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481f61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44876 expref: 16 pid: 5840 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.067810:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e79228dad00) 00010000:00010000:1.0:1787823604.067814:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481fa7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.067834:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481fa7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.067842:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481fa7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.067864:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823604.067937:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:353832f0-fe7b-4d99-975c-a8041babed42+15:2353:x1874668629845120:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 237us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823604.067944:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 55 00010000:00010000:0.0:1787823604.068242:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481fa7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.068249:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481fa7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.068278:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481fa7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.068286:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481fa7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.068293:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481fa7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.068299:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40e600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823604.068304:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481fa7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.068311:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481fa7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.068323:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e79228dad00) 00010000:00010000:0.0:1787823604.068325:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787823604.068329:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481fa7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.068335:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481fa7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823604.068378:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a03e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+14:10539:x1874668629844992:12345-192.168.202.35@tcp:55:lhsmtool_posix.0 Request processed in 5089us (5329us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787823604.068392:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 126 00000100:00100000:1.0:1787823604.071082:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823604.071198:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629845248 00000100:00100000:3.0:1787823604.071211:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629845248 00000100:00100000:3.0:1787823604.071278:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 45 00000100:00100000:3.0:1787823604.071291:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:353832f0-fe7b-4d99-975c-a8041babed42+7:2352:x1874668629845248:12345-192.168.202.35@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787823604.071339:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a91f4051/0x5d1142b832481fae lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823604.071360:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006d1569e9/0x5d1142b832481f8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44892 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823604.071388:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787823604.071393:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787823604.071398:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a91f4051/0x5d1142b832481fae lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823604.071433:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006d1569e9/0x5d1142b832481f8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44892 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823604.071448:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006d1569e9/0x5d1142b832481f8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44892 expref: 7 pid: 6687 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823604.071475:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7935169e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6688:1874668651876992:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787823604.071560:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79047073c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787823604.074589:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823604.074657:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629845376 00000100:00100000:1.0:1787823604.074665:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629845376 00010000:00010000:1.0:1787823604.074701:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006d1569e9/0x5d1142b832481f8b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44892 expref: 8 pid: 6687 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823604.074748:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 56 00000100:00100000:1.0:1787823604.074782:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a03c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:353832f0-fe7b-4d99-975c-a8041babed42+8:2352:x1874668629845376:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787823604.074798:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823604.074818:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006d1569e9/0x5d1142b832481f8b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44892 expref: 8 pid: 6687 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.074831:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006d1569e9/0x5d1142b832481f8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44892 expref: 8 pid: 6687 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.074983:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787823604.074988:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787823604.075007:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a91f4051/0x5d1142b832481fae lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.075018:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a91f4051/0x5d1142b832481fae lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.075037:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823604.075084:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a03c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:353832f0-fe7b-4d99-975c-a8041babed42+8:2352:x1874668629845376:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 328us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823604.075091:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 56 00010000:00010000:3.0:1787823604.076165:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d1569e9/0x5d1142b832481f8b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44892 expref: 7 pid: 6687 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823604.076187:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7935169e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6688:1874668651876992:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787823604.076212:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a91f4051/0x5d1142b832481fae lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823604.076223:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a91f4051/0x5d1142b832481fae lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823604.076230:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a91f4051/0x5d1142b832481fae lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823604.076273:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a91f4051/0x5d1142b832481fae lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823604.076281:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a91f4051/0x5d1142b832481fae lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823604.076289:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a91f4051/0x5d1142b832481fae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823604.076296:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26ca00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:3.0:1787823604.076299:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a91f4051/0x5d1142b832481fae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823604.076307:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a91f4051/0x5d1142b832481fae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823604.076322:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a91f4051/0x5d1142b832481fae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823604.076329:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a91f4051/0x5d1142b832481fae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823604.076443:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:353832f0-fe7b-4d99-975c-a8041babed42+6:2352:x1874668629845248:12345-192.168.202.35@tcp:1:lhsmtool_posix.0 Request processed in 5154us (5373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823604.076462:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 45 00000100:00100000:2.0:1787823604.079077:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823604.079182:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629845632 00000100:00100000:0.0:1787823604.079192:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629845632 00000100:00100000:0.0:1787823604.079295:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 127 00000100:00100000:0.0:1787823604.079307:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a03d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+14:10539:x1874668629845632:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787823604.079390:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481fb5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.079409:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481fb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.079422:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481fb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.079658:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832481fbc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.079670:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c000/0x5d1142b832481f6f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4487d expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.079677:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832481fbc lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.079709:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c000/0x5d1142b832481f6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4487d expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.079722:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c000/0x5d1142b832481f6f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4487d expref: 15 pid: 5838 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823604.079802:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793f9bda40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1874668651877120:192.168.202.35@tcp:104: 00000100:00100000:0.0:1787823604.079935:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7902a93b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787823604.083489:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823604.084148:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629845760 00000100:00100000:1.0:1787823604.084158:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629845760 00010000:00010000:1.0:1787823604.084202:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c000/0x5d1142b832481f6f lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4487d expref: 16 pid: 5838 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823604.084244:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 57 00000100:00100000:1.0:1787823604.084254:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:353832f0-fe7b-4d99-975c-a8041babed42+16:2353:x1874668629845760:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787823604.084270:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823604.084278:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c000/0x5d1142b832481f6f lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4487d expref: 16 pid: 5838 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.084292:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c000/0x5d1142b832481f6f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4487d expref: 16 pid: 5838 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.084317:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e79228dad00) 00010000:00010000:1.0:1787823604.084323:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832481fbc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.084352:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832481fbc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.084360:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832481fbc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.084379:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823604.084457:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:353832f0-fe7b-4d99-975c-a8041babed42+16:2353:x1874668629845760:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 196us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823604.084465:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 57 00010000:00010000:2.0:1787823604.085581:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c000/0x5d1142b832481f6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4487d expref: 15 pid: 5838 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823604.085603:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793f9bda40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1874668651877120:192.168.202.35@tcp:104: 00010000:00010000:2.0:1787823604.085629:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832481fbc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823604.085640:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832481fbc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823604.085664:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832481fbc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787823604.086111:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1787823604.086261:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1787823604.086309:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1787823604.086398:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a03c780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5839:1874668651877248:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787823604.086479:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823604.086518:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7918672d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787823604.086594:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651877248 00000100:00100000:3.0:1787823604.086601:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651877248 00000100:00100000:3.0:1787823604.086652:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787823604.086661:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a03f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5839:x1874668651877248:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787823604.086780:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a03f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5839:x1874668651877248:12345-0@lo:1000:mdt00_001.0 Request processed in 99us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823604.086788:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787823604.087312:0:5839:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1787823604.087321:0:5839:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:1.0:1787823604.087345:0:5839:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e793a0eda40, transno 4294967309 00000004:00080000:1.0:1787823604.087363:0:5839:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e793a0ede00, transno 4294967310 00000100:00100000:1.0:1787823604.087370:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a03c780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5839:1874668651877248:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1787823604.088081:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:1.0:1787823604.088169:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792e80cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5839:1874668651877376:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787823604.088237:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823604.088324:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7903ca7000 going to sleep for 11 seconds 00000100:00100000:3.0:1787823604.089053:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651877376 00000100:00100000:3.0:1787823604.089062:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651877376 00000100:00100000:3.0:1787823604.089142:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787823604.089150:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5839:x1874668651877376:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787823604.089355:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5839:x1874668651877376:12345-0@lo:1000:mdt00_001.0 Request processed in 204us (1116us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787823604.089362:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787823604.089442:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792e80cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5839:1874668651877376:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1787823604.089491:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832481fbc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.089502:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832481fbc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.089511:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832481fbc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.089532:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40fa00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823604.089538:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832481fbc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.089547:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832481fbc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.089567:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e79228dad00) 00010000:00010000:1.0:1787823604.089570:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787823604.089576:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832481fbc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.089583:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832481fbc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.089617:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b832481eff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.089623:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b832481eff lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.089629:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b832481eff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.089634:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40ea00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823604.089636:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b832481eff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.089642:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b832481eff lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.089659:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e79087c9800) 00010000:00010000:1.0:1787823604.089661:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787823604.089668:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481f06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44861 expref: 18 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.089679:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481f06 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44861 expref: 18 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.089688:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481f06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44861 expref: 18 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.089717:0:5839:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481f06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44861 expref: 18 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823604.089740:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea8cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1874668651877504:192.168.202.35@tcp:105: 00000100:00100000:1.0:1787823604.089835:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e790ad6ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1787823604.094066:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823604.094145:0:12014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629845888 00000100:00100000:2.0:1787823604.094157:0:12014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629845888 00000100:00100000:2.0:1787823604.094224:0:12014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 31 00000100:00100000:2.0:1787823604.094234:0:12014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:353832f0-fe7b-4d99-975c-a8041babed42+19:10538:x1874668629845888:12345-192.168.202.35@tcp:49:lfs.0 00000100:00100000:2.0:1787823604.094398:0:12014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:353832f0-fe7b-4d99-975c-a8041babed42+19:10538:x1874668629845888:12345-192.168.202.35@tcp:49:lfs.0 Request processed in 163us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823604.094408:0:12014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 31 00000100:00100000:1.0:1787823604.096249:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea8cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1874668651877504:192.168.202.35@tcp:105: 00010000:00010000:1.0:1787823604.096283:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b832481eff lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.096296:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b832481eff lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.096334:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481fc3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.096351:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481fc3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.096376:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481fc3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.096387:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481fc3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.096395:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481fc3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.096402:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481fc3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.096408:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f2200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823604.096412:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481fc3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.096418:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481fc3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.096429:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e79087c9800) 00010000:00010000:1.0:1787823604.096432:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823604.096436:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481fc3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.096442:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481fc3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.096462:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481fb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.096467:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481fb5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.096480:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481fb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.096485:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40e600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823604.096488:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481fb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.096496:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481fb5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.096504:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e79087c9800) 00010000:00010000:1.0:1787823604.096507:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787823604.096510:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481fb5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.096517:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832481fb5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823604.096845:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a03d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+18:10539:x1874668629845632:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 Request processed in 17538us (17776us total) trans 4294967407 rc 0/0 00000100:00100000:1.0:1787823604.096857:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 127 00000020:00080000:1.0:1787823604.096862:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787823604.097527:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787823604.097533:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787823604.098196:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787823604.098207:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787823604.102303:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823604.102377:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823604.102459:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629846400 00000100:00100000:3.0:1787823604.102473:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629846400 00000100:00100000:3.0:1787823604.102537:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 128 00000100:00100000:3.0:1787823604.102548:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+18:10538:x1874668629846400:12345-192.168.202.35@tcp:58:lfs.0 00000040:00080000:3.0:1787823604.103029:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1787823604.103135:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+18:10538:x1874668629846400:12345-192.168.202.35@tcp:58:lfs.0 Request processed in 587us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823604.103144:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 128 00000100:00100000:2.0:1787823604.107471:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629846144 00000100:00100000:2.0:1787823604.107487:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629846144 00000100:00100000:2.0:1787823604.107569:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 32 00000100:00100000:2.0:1787823604.107580:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7925a92850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+18:10539:x1874668629846144:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787823604.108263:0:5842:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787823604.108353:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00010000:00010000:2.0:1787823604.108398:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481fca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823604.108416:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481fca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823604.108438:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481fca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823604.108447:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481fca lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823604.108454:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481fca lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823604.108461:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481fca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823604.108482:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787823604.108570:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7925a92850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+20:10539:x1874668629846144:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 Request processed in 991us (6274us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1787823604.108578:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 32 00000020:00080000:2.0:1787823604.108583:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787823604.108723:0:7629:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787823604.108739:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481fca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.108746:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3400 already unused, calling callback (ffffffffc1649440) 00010000:00010000:1.0:1787823604.108751:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481fca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.108785:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481fca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.108799:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e79228da100) 00010000:00010000:1.0:1787823604.108802:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787823604.108807:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481fca lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.108812:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832481fca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.108828:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823604.108829:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823604.108831:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823604.137633:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823604.137720:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629846528 00000100:00100000:1.0:1787823604.137739:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629846528 00000100:00100000:1.0:1787823604.137829:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 129 00000100:00100000:1.0:1787823604.137840:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+20:10541:x1874668629846528:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:1.0:1787823604.138124:0:7893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823604.138148:0:7893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481fd1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44899 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.138216:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481fd8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.138253:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481fd8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.138265:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481fd8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.138300:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481fdf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.138308:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481fdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.138316:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481fdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.138650:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481fe6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.138664:0:7893:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030200/0x5d1142b832481ef1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4485a expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.138673:0:7893:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481fe6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.138707:0:7893:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030200/0x5d1142b832481ef1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4485a expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.138722:0:7893:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030200/0x5d1142b832481ef1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4485a expref: 21 pid: 5839 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823604.138749:0:7893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea8cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7893:1874668651877632:192.168.202.35@tcp:104: 00000100:00100000:1.0:1787823604.139001:0:7893:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e790ad6ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787823604.141666:0:7893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea8cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7893:1874668651877632:192.168.202.35@tcp:104: 00010000:00010000:1.0:1787823604.141693:0:7893:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481fe6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823604.143082:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823604.143162:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629846784 00000100:00100000:1.0:1787823604.143172:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629846784 00000100:00100000:1.0:1787823604.143228:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 33 00000100:00100000:1.0:1787823604.143238:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+22:5593:x1874668629846784:12345-192.168.202.35@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787823604.143484:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+23:5593:x1874668629846784:12345-192.168.202.35@tcp:35:ldlm_bl.0 Request processed in 246us (407us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1787823604.143492:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 33 00000100:00100000:2.0:1787823604.146106:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823604.146239:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629846912 00000100:00100000:1.0:1787823604.146248:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629846912 00010000:00010000:1.0:1787823604.146287:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030200/0x5d1142b832481ef1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4485a expref: 23 pid: 5839 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823604.146327:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 58 00000100:00100000:1.0:1787823604.146334:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a03cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:353832f0-fe7b-4d99-975c-a8041babed42+23:2352:x1874668629846912:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787823604.146348:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823604.146354:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030200/0x5d1142b832481ef1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4485a expref: 23 pid: 5839 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.146367:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030200/0x5d1142b832481ef1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4485a expref: 23 pid: 5839 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.146386:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030200/0x5d1142b832481ef1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4485a expref: 23 pid: 5839 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.146404:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e79087c9800) 00010000:00010000:1.0:1787823604.146424:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481fe6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.146433:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.146440:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481fe6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823604.146484:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823604.146547:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a03cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:353832f0-fe7b-4d99-975c-a8041babed42+22:2352:x1874668629846912:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 212us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823604.146553:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 58 00010000:00010000:0.0:1787823604.146648:0:7893:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.146656:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787823604.146700:0:7893:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787823604.146704:0:7893:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787823604.146723:0:7893:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.146747:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.146791:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481fd8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.146798:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481fd8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.146804:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481fd8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.146817:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f3600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823604.146821:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481fd8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.146828:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481fd8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.146839:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e791767b200) 00010000:00010000:0.0:1787823604.146842:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823604.146846:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481fd8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.146851:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832481fd8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.146881:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481fdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.146887:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481fdf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.146892:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481fdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.146896:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f2a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823604.146899:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481fdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.146904:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481fdf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.146922:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e7917859900) 00010000:00010000:0.0:1787823604.146924:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823604.146927:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481fdf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.146933:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832481fdf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.146970:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832481fd1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44899 expref: 22 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.146984:0:7893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481fe6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44899 expref: 21 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823604.146991:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e79087c9800) 00010000:00010000:0.0:1787823604.146993:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787823604.146995:0:7893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a2f3a00, rc 0) 00000100:00100000:0.0:1787823604.147023:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+21:10541:x1874668629846528:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 9186us (9402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823604.147030:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 129 00000100:00100000:2.0:1787823604.202528:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787823604.202552:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793f99a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651877760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787823604.202622:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823604.203048:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651877760 00000100:00100000:0.0:1787823604.203058:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651877760 00000100:00100000:0.0:1787823604.203119:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787823604.203129:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a03f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874668651877760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787823604.203165:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787823604.203217:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a03f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874668651877760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823604.203235:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787823604.203318:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793f99a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651877760:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787823604.970234:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787823604.978362:0:12054:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787823604.978372:0:12054:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787823604.978417:0:12054:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787823604.978423:0:12054:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787823605.166432:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787823605.166444:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787823605.166482:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787823605.166489:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787823605.166648:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea8cb40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1874668651877888:192.168.202.35@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787823605.169070:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793516f000 going to sleep for 11 seconds 00000100:00100000:3.0:1787823605.182216:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea8cb40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1874668651877888:192.168.202.35@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787823605.185371:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823605.201043:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629847040 00000100:00100000:2.0:1787823605.201062:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629847040 00000100:00100000:3.0:1787823605.203906:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 130 00000100:00100000:3.0:1787823605.203923:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7935169e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+21:10553:x1874668629847040:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787823605.203960:0:5838:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787823605.204077:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7935169e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+21:10553:x1874668629847040:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 Request processed in 157us (18716us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823605.204086:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 130 00000100:00100000:2.0:1787823605.213987:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823605.214029:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629847296 00000100:00100000:2.0:1787823605.214039:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629847296 00000100:00100000:2.0:1787823605.214105:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 131 00000100:00100000:2.0:1787823605.214116:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a03de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+21:10553:x1874668629847296:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787823605.214140:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823605.214172:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481fed lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f448a0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823605.214298:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481ff4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823605.214315:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823605.214330:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787823605.214341:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787823605.214484:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832481fed lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448a0 expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823605.214505:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481ff4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448a0 expref: 23 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823605.214514:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e79087c9800) 00010000:00010000:2.0:1787823605.214517:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787823605.214520:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d2200, rc 0) 00000100:00100000:2.0:1787823605.214597:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a03de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+23:10553:x1874668629847296:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 481us (622us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1787823605.214606:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 131 00000100:00100000:1.0:1787823605.232993:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823605.233070:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823605.233104:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629847680 00000100:00100000:1.0:1787823605.233114:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629847680 00000100:00100000:1.0:1787823605.233173:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00100000:1.0:1787823605.233183:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:353832f0-fe7b-4d99-975c-a8041babed42+23:2353:x1874668629847680:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787823605.233209:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823605.233234:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832481ff4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448a0 expref: 23 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823605.233252:0:7631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e79087c9800) 00010000:00010000:1.0:1787823605.233257:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823605.233317:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:353832f0-fe7b-4d99-975c-a8041babed42+22:2353:x1874668629847680:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 134us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823605.233326:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00100000:3.0:1787823605.241373:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629847552 00000100:00100000:3.0:1787823605.241389:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629847552 00000100:00100000:3.0:1787823605.241473:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 132 00000100:00100000:3.0:1787823605.241485:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+22:10553:x1874668629847552:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787823605.241578:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ca00/0x5d1142b832482002 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823605.241596:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ca00/0x5d1142b832482002 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823605.241607:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ca00/0x5d1142b832482002 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823605.241868:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ca00/0x5d1142b832482002 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823605.241878:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ca00/0x5d1142b832482002 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823605.241886:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ca00/0x5d1142b832482002 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823605.241911:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26ca00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823605.241916:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ca00/0x5d1142b832482002 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823605.241924:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ca00/0x5d1142b832482002 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823605.241937:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e79087c9800) 00010000:00010000:3.0:1787823605.241940:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787823605.241946:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ca00/0x5d1142b832482002 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823605.241952:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ca00/0x5d1142b832482002 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823605.242129:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+23:10553:x1874668629847552:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 Request processed in 645us (9144us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1787823605.242138:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 132 00000040:00080000:2.0:1787823605.243095:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787823605.243102:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787823605.243570:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787823605.243579:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787823605.250207:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823605.250297:0:12014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629847936 00000100:00100000:3.0:1787823605.250308:0:12014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629847936 00000100:00100000:3.0:1787823605.250368:0:12014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 34 00000100:00100000:3.0:1787823605.250380:0:12014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:353832f0-fe7b-4d99-975c-a8041babed42+23:10553:x1874668629847936:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787823605.250630:0:12014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:353832f0-fe7b-4d99-975c-a8041babed42+24:10553:x1874668629847936:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 Request processed in 252us (431us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1787823605.250639:0:12014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 34 00000100:00100000:3.0:1787823605.445167:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823605.445220:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823605.445271:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823605.445312:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823605.445349:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629848448 00000100:00100000:3.0:1787823605.445360:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629848448 00000100:00100000:3.0:1787823605.445433:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 139 00000100:00100000:3.0:1787823605.445444:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790aef0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2354:x1874668629848448:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787823605.445620:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629848064 00000100:00100000:1.0:1787823605.445625:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629848064 00000100:00100000:1.0:1787823605.445663:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 290 00000100:00100000:1.0:1787823605.445672:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+13:2354:x1874668629848064:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787823605.445804:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+13:2354:x1874668629848064:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 133us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823605.445812:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 290 00000100:00100000:0.0:1787823605.446085:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629848320 00000100:00100000:0.0:1787823605.446091:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629848320 00000100:00100000:0.0:1787823605.446131:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629848192 00000100:00100000:0.0:1787823605.446134:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629848192 00000100:00100000:0.0:1787823605.446149:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 78 00000100:00100000:0.0:1787823605.446155:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792eb04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+6:2354:x1874668629848320:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787823605.446186:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792eb04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+6:2354:x1874668629848320:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 33us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823605.446192:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 78 00000100:00100000:0.0:1787823605.446203:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 79 00000100:00100000:0.0:1787823605.446208:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790aef1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+5:2354:x1874668629848192:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787823605.446227:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790aef1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+5:2354:x1874668629848192:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 20us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823605.446232:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 79 00000100:00080000:0.0:1787823605.446262:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787823605.446265:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787823605.446268:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787823605.447257:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790aef0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2354:x1874668629848448:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 1807us (1935us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823605.447268:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 139 00010000:00010000:0.0:1787823605.994645:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823606.250055:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a03fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651878016:0@lo:400:kworker.0 00000100:00100000:1.0:1787823606.250066:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a03e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874668651878272:0@lo:400:kworker.0 00000100:00100000:2.0:1787823606.250175:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a03f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874668651878144:0@lo:400:kworker.0 00000100:00100000:0.0:1787823606.257220:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a03da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651878400:0@lo:400:kworker.0 00000100:00100000:3.0:1787823606.259553:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823606.259752:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a03e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874668651878528:0@lo:400:kworker.0 00000100:00100000:3.0:1787823606.259885:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823606.259930:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651878528 00000100:00100000:3.0:1787823606.259941:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651878528 00000100:00080000:3.0:1787823606.259986:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787823606.260547:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787823606.260563:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874668651878528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823606.260639:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874668651878528:12345-0@lo:400:kworker.0 Request processed in 81us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823606.260647:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787823606.260787:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a03e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874668651878528:0@lo:400:kworker.0 00000100:00100000:1.0:1787823606.261547:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823606.261598:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651878272 00000100:00100000:3.0:1787823606.261605:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651878272 00000100:00100000:1.0:1787823606.261632:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651878016 00000100:00100000:1.0:1787823606.261637:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651878016 00000100:00100000:3.0:1787823606.261653:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787823606.261661:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874668651878272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823606.261663:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1787823606.261679:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3306:x1874668651878016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823606.261742:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3306:x1874668651878016:12345-0@lo:400:kworker.0 Request processed in 74us (2197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823606.261789:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1787823606.261811:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874668651878272:12345-0@lo:400:kworker.0 Request processed in 151us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823606.261818:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:3.0:1787823606.261832:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787823606.261834:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a03e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874668651878272:0@lo:400:kworker.0 00000100:00100000:3.0:1787823606.261868:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a03fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651878016:0@lo:400:kworker.0 00000100:00100000:0.0:1787823606.274116:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823606.274214:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651878400 00000100:00100000:0.0:1787823606.274224:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651878400 00000100:00100000:0.0:1787823606.274285:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787823606.274295:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f999680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1874668651878400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823606.274361:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f999680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1874668651878400:12345-0@lo:400:kworker.0 Request processed in 68us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823606.274368:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1787823606.274390:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787823606.274424:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a03da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651878400:0@lo:400:kworker.0 00000100:00100000:2.0:1787823606.274649:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823606.274693:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a03c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651878656:0@lo:400:kworker.0 00000100:00100000:2.0:1787823606.274744:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823606.274788:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651878656 00000100:00100000:2.0:1787823606.274792:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651878656 00000100:00100000:2.0:1787823606.274825:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787823606.274832:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a03ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1874668651878656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823606.274865:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a03ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1874668651878656:12345-0@lo:400:kworker.0 Request processed in 34us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823606.274872:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:2.0:1787823606.274888:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787823606.274907:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a03c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651878656:0@lo:400:kworker.0 00000100:00100000:0.0:1787823606.275393:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651878144 00000100:00100000:0.0:1787823606.275398:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651878144 00000100:00100000:0.0:1787823606.275518:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787823606.275526:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a03d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874668651878144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823606.275575:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a03d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874668651878144:12345-0@lo:400:kworker.0 Request processed in 50us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823606.275581:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787823606.275627:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a03f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874668651878144:0@lo:400:kworker.0 00000100:00100000:1.0:1787823606.763749:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a03c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651878784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787823606.763881:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823606.766443:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651878784 00000100:00100000:0.0:1787823606.766459:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651878784 00000100:00100000:0.0:1787823606.766520:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787823606.766531:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1874668651878784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787823606.766570:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787823606.766667:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1874668651878784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (2786us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823606.766675:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787823606.766795:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a03c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651878784:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787823607.017941:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787823607.205358:0:12106:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787823607.205368:0:12106:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787823607.205454:0:12106:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787823607.205460:0:12106:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787823607.482108:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823607.482188:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629848704 00000100:00100000:0.0:1787823607.482200:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629848704 00000100:00100000:0.0:1787823607.482304:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 133 00000100:00100000:0.0:1787823607.482317:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a03c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+24:10573:x1874668629848704:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787823607.482359:0:7893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823607.482381:0:7893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f400/0x5d1142b832482009 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f448a7 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823607.482497:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832482010 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823607.482513:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832482010 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823607.482526:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832482010 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787823607.482537:0:7893:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787823607.482668:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f400/0x5d1142b832482009 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448a7 expref: 27 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823607.482686:0:7893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832482010 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448a7 expref: 26 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823607.482707:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e79087c9800) 00010000:00010000:0.0:1787823607.482711:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787823607.482714:0:7893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40fe00, rc 0) 00000100:00100000:0.0:1787823607.482809:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a03c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+26:10573:x1874668629848704:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 495us (712us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1787823607.482816:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 133 00000100:00080000:2.0:1787823607.483105:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787823607.495254:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823607.495405:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629848832 00000100:00100000:1.0:1787823607.495416:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629848832 00000100:00100000:1.0:1787823607.495477:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 134 00000100:00100000:1.0:1787823607.495488:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a03f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+26:10573:x1874668629848832:12345-192.168.202.35@tcp:54:lfs.0 00010000:00010000:1.0:1787823607.495557:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248201e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823607.495575:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248201e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823607.495586:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248201e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823607.495614:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248201e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823607.495622:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248201e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823607.495636:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248201e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823607.495642:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f2e00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823607.495646:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248201e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823607.495655:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248201e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823607.495668:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e79087c9800) 00010000:00010000:1.0:1787823607.495671:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787823607.495676:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248201e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823607.495681:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248201e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823607.495811:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a03f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+26:10573:x1874668629848832:12345-192.168.202.35@tcp:54:lfs.0 Request processed in 325us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823607.495819:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 134 00000100:00100000:0.0:1787823607.637119:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823607.637474:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629848960 00000100:00100000:2.0:1787823607.637484:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629848960 00000100:00100000:2.0:1787823607.637559:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 46 00000100:00100000:2.0:1787823607.637568:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f998780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+6:2354:x1874668629848960:12345-192.168.202.35@tcp:101:cat.0 00010000:00010000:2.0:1787823607.637585:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823607.637605:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b832482025 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f448ae expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787823607.637629:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9005f3, atime: 0x6a9005f3, ctime: 0x6a9005f3, blocks: 0xb 00010000:00010000:2.0:1787823607.637647:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=348s v=(0 0) 00010000:00010000:2.0:1787823607.637666:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823607.637675:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b832482025 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448ae expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823607.637715:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b832482025 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448ae expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823607.637729:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d3c00, rc 0) 00000100:00100000:2.0:1787823607.637823:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f998780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+7:2354:x1874668629848960:12345-192.168.202.35@tcp:101:cat.0 Request processed in 255us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823607.637830:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 46 00000100:00080000:0.0:1787823607.637875:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787823607.641325:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823607.641432:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629849088 00000100:00100000:1.0:1787823607.641443:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629849088 00002000:00100000:1.0:1787823607.641498:0:6692:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8e793a03da40 x1874668629849088/t0(0) o3->353832f0-fe7b-4d99-975c-a8041babed42@192.168.202.35@tcp:228/0 lens 488/0 e 0 to 0 dl 1787823618 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787823607.641513:0:6692:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8e793a03da40 with x1874668629849088 ext(0->4095) 00002000:00010000:1.0:1787823607.641518:0:6692:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e793a03da40 00000100:00100000:1.0:1787823607.641545:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 3 00000100:00100000:1.0:1787823607.641554:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a03da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:353832f0-fe7b-4d99-975c-a8041babed42+7:2353:x1874668629849088:12345-192.168.202.35@tcp:3:cat.0 00000100:00100000:1.0:1787823607.641899:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a03da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:353832f0-fe7b-4d99-975c-a8041babed42+7:2353:x1874668629849088:12345-192.168.202.35@tcp:3:cat.0 Request processed in 344us (582us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787823607.641907:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 3 00002000:00100000:1.0:1787823607.641915:0:6692:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8e793a03da40 x1874668629849088/t0(0) o3->353832f0-fe7b-4d99-975c-a8041babed42@192.168.202.35@tcp:228/0 lens 488/4536 e 0 to 0 dl 1787823618 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787823607.641923:0:6692:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8e793a03da40 with x1874668629849088 ext(0->4095) 00002000:00010000:1.0:1787823607.641926:0:6692:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e793a03da40 00010000:00010000:1.0:1787823608.042033:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787823608.978135:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00010000:00010000:0.0:1787823609.066816:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823609.327622:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a03fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651878912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787823609.327712:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823609.327816:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651878912 00000100:00100000:0.0:1787823609.327824:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651878912 00000100:00100000:0.0:1787823609.327878:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787823609.327887:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f99b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651878912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787823609.327921:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787823609.329498:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f99b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651878912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1603us (1778us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823609.329511:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1787823609.329545:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787823609.330800:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1787823609.330810:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e7922b88780, transno 4294967304 00000100:00100000:1.0:1787823609.330842:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a03fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651878912:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1787823609.390046:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1787823609.390062:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:1.0:1787823609.413927:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1787823609.413950:0:5860:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1787823609.413980:0:5860:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e7908c23e40 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1787823609.413985:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e7909befb00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e7908c23cc0 00000020:00080000:1.0:1787823609.413989:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e7909bef100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e7939d88000 00000020:00080000:2.0:1787823609.414074:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1787823609.414280:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:0.0:1787823610.091918:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787823610.349843:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787823610.349854:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787823610.349899:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787823610.349906:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787823610.566326:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823610.566372:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823610.566415:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823610.566440:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823610.566485:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823610.566518:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629849728 00000100:00100000:1.0:1787823610.566528:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629849728 00000100:00100000:1.0:1787823610.566583:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629849344 00000100:00100000:1.0:1787823610.566586:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629849344 00000100:00100000:1.0:1787823610.566622:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 143 00000100:00100000:1.0:1787823610.566632:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2355:x1874668629849728:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787823610.566719:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2355:x1874668629849728:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 87us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823610.566727:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 143 00000100:00100000:1.0:1787823610.566745:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 144 00000100:00100000:1.0:1787823610.566752:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+13:2355:x1874668629849344:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787823610.566920:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+13:2355:x1874668629849344:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 60us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823610.566930:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 144 00000100:00100000:1.0:1787823610.566952:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629849472 00000100:00100000:1.0:1787823610.566956:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629849472 00000100:00100000:1.0:1787823610.566982:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629849600 00000100:00100000:1.0:1787823610.566985:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629849600 00000100:00100000:1.0:1787823610.567002:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 82 00000100:00100000:1.0:1787823610.567008:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+5:2355:x1874668629849472:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787823610.567036:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+5:2355:x1874668629849472:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 28us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823610.567042:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 82 00000100:00100000:1.0:1787823610.567125:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 83 00000100:00100000:1.0:1787823610.567132:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+6:2355:x1874668629849600:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787823610.567159:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+6:2355:x1874668629849600:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 28us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823610.567166:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 83 00000100:00080000:1.0:1787823610.567183:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787823610.567195:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787823610.567197:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787823610.567631:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629849216 00000100:00100000:0.0:1787823610.567636:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629849216 00000100:00100000:0.0:1787823610.567680:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 292 00000100:00100000:0.0:1787823610.567689:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+13:2355:x1874668629849216:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787823610.567724:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+13:2355:x1874668629849216:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 36us (1411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823610.567731:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 292 00010000:00010000:2.0:1787823611.116345:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823611.370227:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651879424:0@lo:400:kworker.0 00000100:00100000:1.0:1787823611.370319:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823611.370387:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787823611.370393:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651879040:0@lo:400:kworker.0 00000100:00100000:1.0:1787823611.370423:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823611.370442:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874668651879552:0@lo:400:kworker.0 00000100:00100000:1.0:1787823611.370463:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823611.370486:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874668651879168:0@lo:400:kworker.0 00000100:00100000:1.0:1787823611.370505:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823611.370518:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651879680:0@lo:400:kworker.0 00000100:00100000:1.0:1787823611.370534:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823611.370551:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787823611.370556:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874668651879296:0@lo:400:kworker.0 00000100:00100000:1.0:1787823611.370574:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823611.370599:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651879424 00000100:00100000:1.0:1787823611.370606:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651879424 00000100:00100000:1.0:1787823611.370648:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651879680 00000100:00100000:1.0:1787823611.370650:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651879680 00000100:00100000:1.0:1787823611.370679:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787823611.370687:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fd6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651879424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823611.370733:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fd6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651879424:12345-0@lo:400:kworker.0 Request processed in 47us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823611.370740:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787823611.370755:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787823611.370787:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fd4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651879680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823611.370894:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fd4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651879680:12345-0@lo:400:kworker.0 Request processed in 107us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823611.370901:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787823611.370919:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651879040 00000100:00100000:1.0:1787823611.370922:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651879040 00000100:00100000:1.0:1787823611.370943:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1787823611.370948:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3305:x1874668651879040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823611.370972:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3305:x1874668651879040:12345-0@lo:400:kworker.0 Request processed in 24us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823611.370978:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1787823611.370999:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651879552 00000100:00100000:1.0:1787823611.371002:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651879552 00000100:00100000:1.0:1787823611.371024:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651879168 00000100:00100000:1.0:1787823611.371026:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651879168 00000100:00100000:1.0:1787823611.371035:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651879296 00000100:00100000:1.0:1787823611.371037:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651879296 00000100:00100000:1.0:1787823611.371049:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787823611.371054:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874668651879552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823611.371079:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874668651879552:12345-0@lo:400:kworker.0 Request processed in 24us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823611.371085:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787823611.371094:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787823611.371098:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fd5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874668651879168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823611.371117:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fd5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874668651879168:12345-0@lo:400:kworker.0 Request processed in 19us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823611.371122:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787823611.371130:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787823611.371142:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874668651879296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823611.371163:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874668651879296:12345-0@lo:400:kworker.0 Request processed in 22us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823611.371168:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:1.0:1787823611.371191:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787823611.371195:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787823611.371197:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787823611.371229:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874668651879296:0@lo:400:kworker.0 00000100:00100000:1.0:1787823611.371239:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874668651879168:0@lo:400:kworker.0 00000100:00100000:1.0:1787823611.371246:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1787823611.371251:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1787823611.371273:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651879680:0@lo:400:kworker.0 00000100:00100000:1.0:1787823611.371295:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651879040:0@lo:400:kworker.0 00000100:00100000:1.0:1787823611.371303:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874668651879552:0@lo:400:kworker.0 00000100:00100000:1.0:1787823611.371312:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651879424:0@lo:400:kworker.0 00000100:00100000:1.0:1787823611.883337:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a03e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651879808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787823611.883415:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823611.883782:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651879808 00000100:00100000:0.0:1787823611.883790:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651879808 00000100:00100000:0.0:1787823611.883855:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787823611.883866:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fd4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651879808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787823611.883903:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787823611.883966:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fd4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651879808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823611.883974:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787823611.884331:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a03e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651879808:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787823612.138741:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823613.163001:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823613.652138:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823613.652685:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629849856 00000100:00100000:1.0:1787823613.652696:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629849856 00000100:00100000:1.0:1787823613.652997:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 135 00000100:00100000:1.0:1787823613.653011:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f998f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+13:10226:x1874668629849856:12345-192.168.202.35@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787823613.653163:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f998f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+13:10226:x1874668629849856:12345-192.168.202.35@tcp:60:lhsmtool_posix.0 Request processed in 157us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823613.653189:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 135 00000100:00080000:2.0:1787823613.653401:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787823613.660652:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823613.660893:0:12014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629850112 00000100:00100000:3.0:1787823613.660904:0:12014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629850112 00000100:00100000:3.0:1787823613.660971:0:12014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 35 00000100:00100000:3.0:1787823613.660981:0:12014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f99b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:353832f0-fe7b-4d99-975c-a8041babed42+13:10226:x1874668629850112:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787823613.661620:0:12014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f99b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:353832f0-fe7b-4d99-975c-a8041babed42+14:10226:x1874668629850112:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 Request processed in 638us (990us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1787823613.661628:0:12014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 35 00000100:00100000:0.0:1787823613.945393:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823613.945454:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629850240 00000100:00100000:1.0:1787823613.945463:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629850240 00000100:00100000:1.0:1787823613.945529:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 136 00000100:00100000:1.0:1787823613.945536:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f999e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:11025:x1874668629850240:12345-192.168.202.35@tcp:101:lsof.0 00010000:00010000:1.0:1787823613.945556:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823613.945582:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b83248202c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f448b5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823613.945631:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b832482033 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823613.945652:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b832482033 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823613.945664:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b832482033 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787823613.945713:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1787823613.945904:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787823613.945909:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787823613.946008:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b832482033 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823613.946046:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b83248202c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448b5 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823613.946062:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b832482033 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448b5 expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823613.946081:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e791767b600) 00010000:00010000:1.0:1787823613.946084:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787823613.946088:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a2f2e00, rc 0) 00000100:00100000:1.0:1787823613.946251:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f999e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+6:11025:x1874668629850240:12345-192.168.202.35@tcp:101:lsof.0 Request processed in 713us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823613.946258:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 136 00010000:00010000:0.0:1787823614.186979:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823614.446925:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787823614.446972:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a03e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651879936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787823614.449654:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823614.450958:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651879936 00000100:00100000:1.0:1787823614.450974:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651879936 00000100:00080000:3.0:1787823614.451697:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787823614.451728:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787823614.451743:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f99bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651879936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787823614.451930:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787823614.452028:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f99bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651879936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 290us (2393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823614.454472:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787823614.457643:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a03e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651879936:0@lo:13:osp-pre-0-0.0 00000020:00080000:2.0:1787823614.508506:0:5860:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1787823614.508596:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1787823614.508608:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:2.0:1787823614.508744:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:2.0:1787823615.210246:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823615.685599:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823615.685815:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629850496 00000100:00100000:3.0:1787823615.685826:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629850496 00000100:00100000:3.0:1787823615.685907:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 148 00000100:00100000:3.0:1787823615.685919:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f99b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+13:2352:x1874668629850496:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787823615.686041:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f99b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+13:2352:x1874668629850496:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 124us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823615.686049:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 148 00000100:00080000:2.0:1787823615.687264:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787823615.708478:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823615.708526:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823615.708566:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823615.708599:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823615.708640:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629850624 00000100:00100000:0.0:1787823615.708649:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629850624 00000100:00100000:0.0:1787823615.708704:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629850752 00000100:00100000:0.0:1787823615.708707:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629850752 00000100:00100000:0.0:1787823615.708726:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 86 00000100:00100000:0.0:1787823615.708735:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f99a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+5:2353:x1874668629850624:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787823615.708840:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f99a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+5:2353:x1874668629850624:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 105us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823615.708848:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 86 00000100:00100000:0.0:1787823615.708865:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 87 00000100:00100000:0.0:1787823615.708872:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f99a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+6:2352:x1874668629850752:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787823615.708896:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f99a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+6:2352:x1874668629850752:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 25us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823615.708918:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 87 00000100:00100000:1.0:1787823615.709123:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629850368 00000100:00100000:1.0:1787823615.709128:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629850368 00000100:00100000:1.0:1787823615.709161:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 294 00000100:00100000:1.0:1787823615.709169:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+13:2353:x1874668629850368:12345-192.168.202.35@tcp:400:kworker.0 00000100:00080000:2.0:1787823615.709247:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787823615.709258:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787823615.709411:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629850880 00000100:00100000:3.0:1787823615.709417:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629850880 00000100:00100000:3.0:1787823615.709464:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 149 00000100:00100000:3.0:1787823615.709471:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f999a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+6:2353:x1874668629850880:12345-192.168.202.35@tcp:400:kworker.0 00000100:00080000:2.0:1787823615.709997:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787823615.713405:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+13:2353:x1874668629850368:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 4220us (4920us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823615.713422:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 294 00000100:00100000:3.0:1787823615.715066:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f999a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+6:2353:x1874668629850880:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 5579us (6483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823615.715082:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 149 00010000:00010000:1.0:1787823616.235159:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823616.496098:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874668651880320:0@lo:400:kworker.0 00000100:00100000:3.0:1787823616.496171:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823616.496237:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787823616.496244:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874668651880192:0@lo:400:kworker.0 00000100:00100000:3.0:1787823616.496267:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823616.496286:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec64f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651880704:0@lo:400:kworker.0 00000100:00100000:3.0:1787823616.496310:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823616.496356:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651880320 00000100:00100000:3.0:1787823616.496362:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651880320 00000100:00100000:3.0:1787823616.496413:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651880192 00000100:00100000:3.0:1787823616.496417:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651880192 00000100:00100000:3.0:1787823616.496440:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787823616.496449:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874668651880320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823616.496498:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874668651880320:12345-0@lo:400:kworker.0 Request processed in 50us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823616.496522:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787823616.496541:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787823616.496547:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874668651880192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823616.496575:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874668651880192:12345-0@lo:400:kworker.0 Request processed in 28us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823616.496580:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:2.0:1787823616.496586:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787823616.496613:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874668651880192:0@lo:400:kworker.0 00000100:00100000:3.0:1787823616.496637:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874668651880320:0@lo:400:kworker.0 00000100:00100000:0.0:1787823616.500949:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651880064:0@lo:400:kworker.0 00000100:00100000:0.0:1787823616.501039:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823616.501103:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874668651880576:0@lo:400:kworker.0 00000100:00100000:0.0:1787823616.501133:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823616.501172:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787823616.501179:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651880448:0@lo:400:kworker.0 00000100:00100000:0.0:1787823616.501207:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823616.501241:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651880704 00000100:00100000:0.0:1787823616.501248:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651880704 00000100:00100000:0.0:1787823616.501303:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651880448 00000100:00100000:0.0:1787823616.501306:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651880448 00000100:00100000:0.0:1787823616.501329:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787823616.501348:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec67c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651880704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823616.501408:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec67c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651880704:12345-0@lo:400:kworker.0 Request processed in 72us (5097us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823616.501416:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787823616.501433:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787823616.501439:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651880448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823616.501471:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651880448:12345-0@lo:400:kworker.0 Request processed in 33us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823616.501478:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:0.0:1787823616.501497:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787823616.501501:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787823616.501529:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651880448:0@lo:400:kworker.0 00000100:00100000:3.0:1787823616.501904:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec64f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651880704:0@lo:400:kworker.0 00000100:00100000:3.0:1787823616.501928:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651880576 00000100:00100000:3.0:1787823616.501932:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651880576 00000100:00100000:3.0:1787823616.501980:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787823616.501988:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874668651880576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823616.502029:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874668651880576:12345-0@lo:400:kworker.0 Request processed in 43us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823616.502036:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:1.0:1787823616.502100:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787823616.502361:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874668651880576:0@lo:400:kworker.0 00000100:00100000:2.0:1787823616.503561:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651880064 00000100:00100000:2.0:1787823616.503572:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651880064 00000100:00100000:2.0:1787823616.503658:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1787823616.503666:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3306:x1874668651880064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823616.503744:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3306:x1874668651880064:12345-0@lo:400:kworker.0 Request processed in 80us (2705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823616.503752:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1787823616.505547:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651880064:0@lo:400:kworker.0 00000100:00100000:2.0:1787823617.005495:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787823617.005521:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a03c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651880832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787823617.006915:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823617.007108:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651880832 00000100:00100000:2.0:1787823617.007117:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651880832 00000100:00100000:2.0:1787823617.007165:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787823617.007176:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a03e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651880832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787823617.007212:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787823617.007480:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a03e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651880832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 305us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823617.007489:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787823617.007539:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a03c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651880832:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787823617.258942:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787823617.875103:0:12309:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 05:40:16 (1787823616) 00010000:00010000:0.0:1787823618.281872:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823618.966064:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823618.966545:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629851136 00000100:00100000:2.0:1787823618.966555:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629851136 00000100:00100000:2.0:1787823618.966644:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 137 00000100:00100000:2.0:1787823618.966657:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+13:11290:x1874668629851136:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787823618.966676:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823618.966733:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b83248203a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f448bc expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823618.966841:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482041 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823618.966869:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482041 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823618.966881:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482041 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823618.966911:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482048 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823618.966919:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482048 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823618.966926:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482048 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787823618.967491:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787823618.967736:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b83248204f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823618.967749:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b83248204f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823618.967780:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b83248204f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787823618.967792:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787823618.968016:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482041 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823618.968034:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482041 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823618.968041:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482041 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823618.968047:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823618.968052:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482041 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823618.968059:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482041 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823618.968073:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e791767b400) 00010000:00010000:2.0:1787823618.968076:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823618.968081:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482041 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823618.968087:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482041 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823618.968100:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482048 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823618.968106:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482048 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823618.968112:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482048 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823618.968118:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823618.968127:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482048 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823618.968134:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482048 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823618.968142:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8e79228da300) 00010000:00010000:2.0:1787823618.968144:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823618.968147:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482048 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823618.968153:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482048 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823618.968971:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b83248203a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448bc expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823618.968988:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b83248204f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448bc expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823618.968995:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e7917859800) 00010000:00010000:2.0:1787823618.968998:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823618.969001:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d2c00, rc 0) 00000100:00100000:2.0:1787823618.969070:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+15:11290:x1874668629851136:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 2417us (3017us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1787823618.969080:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 137 00000100:00100000:0.0:1787823618.978232:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823618.978272:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823618.978424:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629851392 00000100:00100000:1.0:1787823618.978433:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629851392 00000100:00100000:1.0:1787823618.978495:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 10 00000100:00100000:1.0:1787823618.978503:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79037f0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:353832f0-fe7b-4d99-975c-a8041babed42+15:2352:x1874668629851392:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787823618.978519:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823618.978541:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b83248204f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448bc expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823618.978572:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e7917859800) 00010000:00010000:1.0:1787823618.978577:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823618.978649:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79037f0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:353832f0-fe7b-4d99-975c-a8041babed42+14:2352:x1874668629851392:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 146us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823618.978657:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 10 00000100:00100000:3.0:1787823618.979371:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629851264 00000100:00100000:3.0:1787823618.979380:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629851264 00000100:00100000:3.0:1787823618.979427:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 138 00000100:00100000:3.0:1787823618.979435:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f998b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+14:11290:x1874668629851264:12345-192.168.202.35@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787823618.979530:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f998b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+14:11290:x1874668629851264:12345-192.168.202.35@tcp:59:lhsmtool_posix.0 Request processed in 96us (1307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823618.979537:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 138 00010000:00010000:1.0:1787823619.306039:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823619.566998:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793f99ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651880960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787823619.567105:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1787823619.568999:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787823619.569011:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787823619.573057:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787823619.573078:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787823619.574844:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651880960 00000100:00100000:1.0:1787823619.574856:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651880960 00000100:00100000:1.0:1787823619.574921:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787823619.574932:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651880960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787823619.574970:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787823619.575066:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651880960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (7961us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823619.575074:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1787823619.575096:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787823619.575189:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793f99ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651880960:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1787823619.603006:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00010000:00010000:1.0:1787823620.330180:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823620.419357:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823620.419411:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629851520 00000100:00100000:2.0:1787823620.419422:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629851520 00000100:00100000:2.0:1787823620.419505:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 139 00000100:00100000:2.0:1787823620.419517:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+13:11332:x1874668629851520:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:2.0:1787823620.419549:0:7893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823620.419601:0:7893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b83248205d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f448c3 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.419671:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832482064 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.419686:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832482064 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.419698:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832482064 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.419714:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b83248206b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.419720:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b83248206b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.419726:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b83248206b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787823620.419845:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787823620.420192:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832482064 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.420202:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832482064 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.420209:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832482064 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.420217:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d2c00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823620.420227:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832482064 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.420235:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832482064 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.420250:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e791767b600) 00010000:00010000:2.0:1787823620.420253:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823620.420259:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832482064 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.420266:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832482064 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.420277:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b83248206b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.420282:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b83248206b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.420288:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b83248206b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.420305:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823620.420308:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b83248206b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.420313:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b83248206b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.420321:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8e79228da300) 00010000:00010000:2.0:1787823620.420323:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823620.420332:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b83248206b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.420338:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b83248206b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.420371:0:7893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b83248205d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448c3 expref: 14 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.420381:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e791767b600) 00010000:00010000:2.0:1787823620.420384:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823620.420388:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b83248205d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448c3 expref: 14 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.420396:0:7893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d2800, rc 0) 00000100:00100000:2.0:1787823620.420465:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+13:11332:x1874668629851520:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 950us (1118us total) trans 0 rc 301/301 00000100:00100000:2.0:1787823620.420474:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 139 00000100:00100000:1.0:1787823620.437141:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823620.437194:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629851776 00000100:00100000:1.0:1787823620.437205:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629851776 00000100:00100000:1.0:1787823620.437282:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 140 00000100:00100000:1.0:1787823620.437293:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+13:11332:x1874668629851776:12345-192.168.202.35@tcp:36:lfs.0 00010000:00010000:1.0:1787823620.437601:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823620.437628:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e400/0x5d1142b8324819db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446fc expref: 13 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.437663:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e791767b600) 00010000:00010000:1.0:1787823620.437668:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787823620.437966:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832482072 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.437982:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b832482033 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448b5 expref: 5 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.437991:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832482072 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.438021:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b832482033 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448b5 expref: 5 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.438035:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b832482033 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448b5 expref: 5 pid: 5838 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823620.438050:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7906fd5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1874668651881088:192.168.202.35@tcp:104: 00000100:00100000:1.0:1787823620.438145:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e790bdbec00 going to sleep for 11 seconds 00000100:00100000:1.0:1787823620.443145:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823620.443991:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7906fd5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1874668651881088:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787823620.444019:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832482072 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823620.445247:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629851904 00000100:00100000:2.0:1787823620.445259:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629851904 00010000:00010000:2.0:1787823620.445342:0:7631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b832482033 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448b5 expref: 6 pid: 5838 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823620.445381:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 59 00000100:00100000:2.0:1787823620.445391:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fd6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+6:2352:x1874668629851904:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787823620.445406:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787823620.445413:0:7631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b832482033 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448b5 expref: 6 pid: 5838 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.445447:0:7631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b832482033 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448b5 expref: 6 pid: 5838 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.445469:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b832482033 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448b5 expref: 6 pid: 5838 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.445485:0:7631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e791767b600) 00010000:00010000:2.0:1787823620.445490:0:7631:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832482072 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.445499:0:7631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832482072 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.445507:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832482072 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.445537:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787823620.445602:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fd6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2352:x1874668629851904:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 212us (2465us total) trans 0 rc 0/0 00010000:00010000:3.0:1787823620.445610:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832482072 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823620.445611:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 59 00010000:00010000:3.0:1787823620.445622:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832482072 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823620.445655:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d200/0x5d1142b832482079 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823620.445665:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d200/0x5d1142b832482079 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823620.445675:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d200/0x5d1142b832482079 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787823620.445686:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1787823620.449533:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787823620.449552:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832482072 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.449564:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832482072 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.449573:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832482072 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.449603:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f3600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823620.449609:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832482072 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.449617:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832482072 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.449634:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e791767b600) 00010000:00010000:2.0:1787823620.449638:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823620.449643:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832482072 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.449650:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b832482072 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787823620.449668:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d90521e1 reply state 0000000030fd72d7 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d200/0x5d1142b832482079 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823620.449691:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787823620.449813:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+14:11332:x1874668629851776:12345-192.168.202.35@tcp:36:lfs.0 Request processed in 12517us (12690us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1787823620.449823:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 140 00010000:00010000:2.0:1787823620.452484:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d200/0x5d1142b832482079 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.452499:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d200/0x5d1142b832482079 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.452508:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d200/0x5d1142b832482079 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.452525:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26d200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823620.452530:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d200/0x5d1142b832482079 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.452539:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d200/0x5d1142b832482079 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.452557:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8e79087c9600) 00010000:00010000:2.0:1787823620.452561:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823620.452566:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d200/0x5d1142b832482079 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.452572:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d200/0x5d1142b832482079 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823620.535800:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823620.536311:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629852032 00000100:00100000:0.0:1787823620.536333:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629852032 00000100:00100000:0.0:1787823620.536396:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 141 00000100:00100000:0.0:1787823620.536407:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+13:11340:x1874668629852032:12345-192.168.202.35@tcp:101:lctl.0 00010000:00010000:0.0:1787823620.536431:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823620.536454:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482080 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f448ca expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823620.536517:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e400/0x5d1142b832482087 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823620.536531:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e400/0x5d1142b832482087 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823620.536542:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e400/0x5d1142b832482087 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787823620.536618:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787823620.536629:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787823620.536659:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e400/0x5d1142b832482087 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823620.536878:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482080 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448ca expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823620.536898:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e400/0x5d1142b832482087 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448ca expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823620.536906:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e791767ba00) 00010000:00010000:0.0:1787823620.536909:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787823620.536913:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40e400, rc 0) 00000100:00100000:0.0:1787823620.536985:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+14:11340:x1874668629852032:12345-192.168.202.35@tcp:101:lctl.0 Request processed in 579us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823620.536992:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 141 00000040:00080000:3.0:1787823620.586391:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787823620.586401:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787823620.586647:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1787823620.586655:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787823620.588438:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823620.588539:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629852160 00000100:00100000:1.0:1787823620.588549:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629852160 00000100:00100000:1.0:1787823620.588667:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 142 00000100:00100000:1.0:1787823620.588679:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f99ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+14:11346:x1874668629852160:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:1.0:1787823620.588704:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823620.588730:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248208e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f448d1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.588856:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832482095 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.589402:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832482095 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.589415:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832482095 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.589432:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b83248209c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.589440:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b83248209c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.589446:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b83248209c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.589565:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b8324820a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.589574:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b8324820a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.589593:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b8324820a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787823620.589629:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1787823620.589632:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787823620.589659:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b8324820a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.589687:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832482095 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.589694:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832482095 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.589702:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832482095 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.589708:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f2200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823620.589712:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832482095 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.589721:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832482095 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.589736:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e791767ba00) 00010000:00010000:1.0:1787823620.589739:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823620.589745:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832482095 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.589751:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b832482095 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.589803:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b83248209c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.589810:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b83248209c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.589816:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b83248209c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.589827:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f2a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823620.589830:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b83248209c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.589836:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b83248209c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.589846:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8e7917859300) 00010000:00010000:1.0:1787823620.589848:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823620.589850:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b83248209c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.589856:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b83248209c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.590099:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248208e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448d1 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.590114:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b8324820a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448d1 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.590122:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e7917859e00) 00010000:00010000:1.0:1787823620.590125:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787823620.590127:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a2f3600, rc 0) 00000100:00100000:0.0:1787823620.590501:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f99ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+15:11346:x1874668629852160:12345-192.168.202.35@tcp:101:bash.0 Request processed in 1820us (2069us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823620.590512:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 142 00000100:00100000:3.0:1787823620.598442:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823620.600064:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629852416 00000100:00100000:2.0:1787823620.600084:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629852416 00000100:00100000:2.0:1787823620.600206:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 143 00000100:00100000:2.0:1787823620.600216:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+15:11346:x1874668629852416:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:2.0:1787823620.600237:0:7893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823620.600256:0:7893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b8324820aa lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f448d8 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.600391:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324820b1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.600402:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324820b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.600424:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324820b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.600464:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b8324820b8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.600469:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b8324820b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.600473:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b8324820b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787823620.600942:0:7893:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1787823620.601063:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324820bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.601071:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324820bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.601078:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324820bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.601110:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324820b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.601116:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324820b1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.601122:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324820b1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.601128:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823620.601138:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324820b1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.601146:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324820b1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.601157:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e7917859e00) 00010000:00010000:2.0:1787823620.601160:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823620.601164:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324820b1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.601170:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324820b1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787823620.601183:0:7893:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007302256f reply state 000000000b4542bc transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b8324820b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823620.601190:0:7893:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787823620.601215:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b8324820aa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448d8 expref: 18 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.601227:0:7893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324820bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448d8 expref: 17 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.601234:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228da100) 00010000:00010000:2.0:1787823620.601236:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787823620.601239:0:7893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d3400, rc 0) 00000100:00100000:3.0:1787823620.604975:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+18:11346:x1874668629852416:12345-192.168.202.35@tcp:101:bash.0 Request processed in 4742us (6530us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1787823620.604991:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 143 00010000:00010000:0.0:1787823620.618277:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b8324820b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823620.618305:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b8324820b8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823620.618314:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b8324820b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823620.618320:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d2c00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823620.618339:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b8324820b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823620.618348:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b8324820b8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823620.618365:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e79228da300) 00010000:00010000:0.0:1787823620.618368:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823620.618373:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b8324820b8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823620.618380:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b8324820b8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823620.618880:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823620.619047:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629852544 00000100:00100000:0.0:1787823620.619056:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629852544 00000100:00100000:0.0:1787823620.619125:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 47 00000100:00100000:0.0:1787823620.619135:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec65a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:353832f0-fe7b-4d99-975c-a8041babed42+5:2354:x1874668629852544:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:0.0:1787823620.619153:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823620.619171:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000455794f8/0x5d1142b8324820cd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f448df expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787823620.619197:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787823620.619217:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=361s v=(0 0) 00010000:00010000:0.0:1787823620.619222:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787823620.619231:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000455794f8/0x5d1142b8324820cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448df expref: 6 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823620.619249:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000455794f8/0x5d1142b8324820cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448df expref: 6 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823620.619285:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40f600, rc 0) 00000100:00100000:0.0:1787823620.619360:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec65a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:353832f0-fe7b-4d99-975c-a8041babed42+6:2354:x1874668629852544:12345-192.168.202.35@tcp:101:bash.0 Request processed in 226us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823620.619367:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 47 00000100:00080000:1.0:1787823620.619577:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787823620.622456:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823620.623920:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629852672 00000100:00100000:0.0:1787823620.623941:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629852672 00000100:00100000:0.0:1787823620.624018:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 48 00000100:00100000:0.0:1787823620.624028:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fd43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+6:11346:x1874668629852672:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:0.0:1787823620.624051:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823620.624074:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000568f6e6e/0x5d1142b8324820d4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f448e6 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823620.624110:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000455794f8/0x5d1142b8324820cd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448df expref: 7 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823620.624120:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787823620.624124:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787823620.624130:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000568f6e6e/0x5d1142b8324820d4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448e6 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823620.624166:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000455794f8/0x5d1142b8324820cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448df expref: 7 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823620.624178:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000455794f8/0x5d1142b8324820cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448df expref: 7 pid: 6688 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823620.624206:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793f99a580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6686:1874668651881216:192.168.202.35@tcp:104: 00000100:00100000:0.0:1787823620.624525:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e792ec58000 going to sleep for 11 seconds 00000100:00100000:3.0:1787823620.628493:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823620.629733:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793f99a580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6686:1874668651881216:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787823620.629811:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000568f6e6e/0x5d1142b8324820d4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448e6 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823620.629834:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40fa00, rc 0) 00000100:00100000:0.0:1787823620.630447:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fd43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+7:11346:x1874668629852672:12345-192.168.202.35@tcp:101:bash.0 Request processed in 6418us (7998us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823620.630458:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 48 00000100:00100000:1.0:1787823620.632206:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629852800 00000100:00100000:1.0:1787823620.632223:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629852800 00010000:00010000:1.0:1787823620.632285:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000455794f8/0x5d1142b8324820cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448df expref: 7 pid: 6688 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823620.632361:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 60 00000100:00100000:1.0:1787823620.632371:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec66940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:353832f0-fe7b-4d99-975c-a8041babed42+7:2352:x1874668629852800:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787823620.632388:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823620.632413:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000455794f8/0x5d1142b8324820cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448df expref: 7 pid: 6688 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.632427:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000455794f8/0x5d1142b8324820cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448df expref: 7 pid: 6688 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.632452:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000455794f8/0x5d1142b8324820cd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448df expref: 7 pid: 6688 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.632468:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787823620.632473:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787823620.632482:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000568f6e6e/0x5d1142b8324820d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448e6 expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.632492:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000568f6e6e/0x5d1142b8324820d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448e6 expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.632530:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000568f6e6e/0x5d1142b8324820d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448e6 expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823620.632544:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7906fd52c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5823:1874668651881344:192.168.202.35@tcp:105: 00000100:00100000:1.0:1787823620.632643:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e790bdbed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787823620.636381:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7906fd52c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5823:1874668651881344:192.168.202.35@tcp:105: 00010000:00010000:1.0:1787823620.636406:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823620.636462:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec66940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:353832f0-fe7b-4d99-975c-a8041babed42+6:2352:x1874668629852800:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 4092us (7978us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823620.636474:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 60 00000100:00100000:3.0:1787823620.637201:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823620.638558:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629853056 00000100:00100000:0.0:1787823620.638572:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629853056 00000100:00100000:0.0:1787823620.638647:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 36 00000100:00100000:0.0:1787823620.638657:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+17:11346:x1874668629853056:12345-192.168.202.35@tcp:35:bash.0 00000100:00100000:0.0:1787823620.641195:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+18:11346:x1874668629853056:12345-192.168.202.35@tcp:35:bash.0 Request processed in 2528us (3988us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1787823620.641210:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 36 00000100:00100000:2.0:1787823620.796090:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823620.796206:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629853312 00000100:00100000:1.0:1787823620.796216:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629853312 00000100:00100000:1.0:1787823620.796287:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 144 00000100:00100000:1.0:1787823620.796297:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a03c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+18:11356:x1874668629853312:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:1.0:1787823620.796337:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823620.796358:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b8324820db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f448ed expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787823620.796475:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787823620.796603:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b8324820db lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448ed expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.796618:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e791767ba00) 00010000:00010000:1.0:1787823620.796620:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787823620.796626:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b8324820db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448ed expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.796640:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a2f2a00, rc 0) 00000100:00100000:1.0:1787823620.796702:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a03c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+19:11356:x1874668629853312:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 407us (623us total) trans 4294967420 rc 301/301 00000100:00100000:1.0:1787823620.796709:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 144 00000100:00100000:2.0:1787823620.802265:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823620.802538:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629853568 00000100:00100000:3.0:1787823620.802548:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629853568 00000100:00100000:3.0:1787823620.802617:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 37 00000100:00100000:3.0:1787823620.802629:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a03e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+19:11356:x1874668629853568:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:3.0:1787823620.803198:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a03e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+20:11356:x1874668629853568:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 569us (941us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1787823620.803206:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 37 00000100:00100000:3.0:1787823620.807041:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823620.807096:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823620.807294:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629853696 00000100:00100000:1.0:1787823620.807304:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629853696 00000100:00100000:1.0:1787823620.807387:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 296 00000100:00100000:1.0:1787823620.807397:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+13:2352:x1874668629853696:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787823620.807476:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+13:2352:x1874668629853696:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 80us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823620.807484:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 296 00000100:00100000:2.0:1787823620.807933:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629853824 00000100:00100000:2.0:1787823620.807938:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629853824 00000100:00100000:2.0:1787823620.808016:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 90 00000100:00100000:2.0:1787823620.808024:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec65680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+6:2352:x1874668629853824:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787823620.808065:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec65680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+6:2352:x1874668629853824:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 43us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823620.808071:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 90 00000100:00080000:1.0:1787823620.808378:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787823620.939156:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823620.939310:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629853952 00000100:00100000:0.0:1787823620.939321:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629853952 00000100:00100000:0.0:1787823620.939381:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 145 00000100:00100000:0.0:1787823620.939391:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+20:11362:x1874668629853952:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787823620.939416:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823620.939436:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b8324820e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f448f4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823620.939515:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b8324820f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823620.939529:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b8324820f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823620.939541:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b8324820f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787823620.939606:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787823620.939613:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787823620.939635:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b8324820f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823620.939661:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b8324820e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448f4 expref: 22 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823620.939681:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b8324820f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448f4 expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823620.939690:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e7917859e00) 00010000:00010000:0.0:1787823620.939694:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787823620.939697:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40e600, rc 0) 00000100:00100000:0.0:1787823620.939817:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+21:11362:x1874668629853952:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 427us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823620.939825:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 145 00000100:00100000:2.0:1787823620.947402:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823620.948070:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629854208 00000100:00100000:1.0:1787823620.948081:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629854208 00000100:00100000:1.0:1787823620.948145:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 146 00000100:00100000:1.0:1787823620.948156:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a03fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+21:11362:x1874668629854208:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:1.0:1787823620.948272:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823620.948295:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b8324820f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f448fb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.948407:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b8324820fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.948422:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b8324820fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.948435:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b8324820fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787823620.948446:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787823620.948574:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b8324820f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448fb expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.948623:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b8324820fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448fb expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.948632:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228da100) 00010000:00010000:1.0:1787823620.948635:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787823620.948639:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a2f2200, rc 0) 00000100:00100000:1.0:1787823620.948705:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a03fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+23:11362:x1874668629854208:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 551us (1314us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1787823620.948713:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 146 00000100:00100000:2.0:1787823620.953148:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823620.953341:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629854464 00000100:00100000:0.0:1787823620.953351:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629854464 00000100:00100000:0.0:1787823620.953427:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 147 00000100:00100000:0.0:1787823620.953437:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a03c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+23:11362:x1874668629854464:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787823620.953459:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823620.953478:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b83248210c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44902 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823620.953567:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832482113 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823620.953598:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832482113 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823620.953611:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832482113 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787823620.953625:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787823620.953754:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b83248210c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44902 expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823620.953793:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832482113 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44902 expref: 25 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823620.953801:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228da100) 00010000:00010000:0.0:1787823620.953803:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787823620.953806:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40f000, rc 0) 00000100:00100000:0.0:1787823620.953865:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a03c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+25:11362:x1874668629854464:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 430us (729us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1787823620.953871:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 147 00000100:00100000:3.0:1787823620.954982:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823620.955554:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629854592 00000100:00100000:1.0:1787823620.955563:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629854592 00000100:00100000:1.0:1787823620.955629:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 11 00000100:00100000:1.0:1787823620.955637:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:353832f0-fe7b-4d99-975c-a8041babed42+25:2354:x1874668629854592:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787823620.955649:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823620.955665:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b8324820fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448fb expref: 25 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.955676:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228da100) 00010000:00010000:1.0:1787823620.955678:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823620.955713:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:353832f0-fe7b-4d99-975c-a8041babed42+24:2354:x1874668629854592:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 78us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823620.955727:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 11 00000100:00100000:3.0:1787823620.961070:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823620.961181:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629854720 00000100:00100000:0.0:1787823620.961201:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629854720 00000100:00100000:0.0:1787823620.961244:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 49 00000100:00100000:0.0:1787823620.961251:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec64780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+6:2353:x1874668629854720:12345-192.168.202.35@tcp:1:lfs.0 00010000:00010000:0.0:1787823620.961289:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000402786d7/0x5d1142b832482121 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823620.961311:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000568f6e6e/0x5d1142b8324820d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448e6 expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823620.961317:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787823620.961320:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787823620.961324:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000402786d7/0x5d1142b832482121 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823620.961349:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000568f6e6e/0x5d1142b8324820d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448e6 expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823620.961358:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000568f6e6e/0x5d1142b8324820d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448e6 expref: 6 pid: 6686 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823620.961368:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793f99a580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6686:1874668651881472:192.168.202.35@tcp:104: 00000100:00100000:0.0:1787823620.961442:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e792ec58000 going to sleep for 11 seconds 00000100:00100000:2.0:1787823620.965140:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793f99a580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6686:1874668651881472:192.168.202.35@tcp:104: 00010000:00010000:2.0:1787823620.965184:0:6686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000402786d7/0x5d1142b832482121 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823620.966800:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823620.968087:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629854848 00000100:00100000:1.0:1787823620.968101:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629854848 00002000:00100000:1.0:1787823620.968160:0:6692:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8e792ec64b40 x1874668629854848/t0(0) o4->353832f0-fe7b-4d99-975c-a8041babed42@192.168.202.35@tcp:241/0 lens 504/0 e 0 to 0 dl 1787823631 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787823620.968254:0:6692:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8e792ec64b40 with x1874668629854848 ext(0->12) 00010000:00010000:1.0:1787823620.968265:0:6692:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000568f6e6e/0x5d1142b8324820d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448e6 expref: 7 pid: 6686 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.968282:0:6692:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000568f6e6e/0x5d1142b8324820d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448e6 expref: 7 pid: 6686 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787823620.968290:0:6692:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e792ec64b40 00000100:00100000:1.0:1787823620.968435:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 2 00000100:00100000:1.0:1787823620.968446:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec64b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:353832f0-fe7b-4d99-975c-a8041babed42+7:2353:x1874668629854848:12345-192.168.202.35@tcp:4:lfs.0 00000100:00100000:1.0:1787823620.969127:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec64b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:353832f0-fe7b-4d99-975c-a8041babed42+9:2353:x1874668629854848:12345-192.168.202.35@tcp:4:lfs.0 Request processed in 681us (2372us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787823620.969137:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 2 00002000:00100000:1.0:1787823620.969146:0:6692:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8e792ec64b40 x1874668629854848/t4294967305(0) o4->353832f0-fe7b-4d99-975c-a8041babed42@192.168.202.35@tcp:241/0 lens 504/448 e 0 to 0 dl 1787823631 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787823620.969155:0:6692:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8e792ec64b40 with x1874668629854848 ext(0->12) 00010000:00010000:1.0:1787823620.969162:0:6692:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000568f6e6e/0x5d1142b8324820d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448e6 expref: 9 pid: 6686 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.969187:0:6692:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000568f6e6e/0x5d1142b8324820d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448e6 expref: 9 pid: 6686 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787823620.969196:0:6692:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e792ec64b40 00000100:00100000:0.0:1787823620.973817:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823620.973949:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629854976 00000100:00100000:3.0:1787823620.973967:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629854976 00010000:00010000:3.0:1787823620.974007:0:7631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000568f6e6e/0x5d1142b8324820d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448e6 expref: 9 pid: 6686 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823620.974050:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 61 00000100:00100000:3.0:1787823620.974059:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f99a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:353832f0-fe7b-4d99-975c-a8041babed42+9:2352:x1874668629854976:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787823620.974090:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787823620.974109:0:7631:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787823620.974112:0:7631:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787823621 00002000:00010000:3.0:1787823620.974114:0:7631:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787823621 00002000:00010000:3.0:1787823620.974116:0:7631:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787823621 00010000:00010000:3.0:1787823620.974124:0:7631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000568f6e6e/0x5d1142b8324820d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448e6 expref: 9 pid: 6686 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823620.974140:0:7631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000568f6e6e/0x5d1142b8324820d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448e6 expref: 9 pid: 6686 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823620.974163:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000568f6e6e/0x5d1142b8324820d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448e6 expref: 9 pid: 6686 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823620.974189:0:7631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787823620.974194:0:7631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787823620.974200:0:7631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000402786d7/0x5d1142b832482121 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823620.974209:0:7631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000402786d7/0x5d1142b832482121 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823620.974237:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787823620.974286:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f99a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:353832f0-fe7b-4d99-975c-a8041babed42+8:2352:x1874668629854976:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 227us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823620.974293:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 61 00010000:00010000:3.0:1787823620.974422:0:6686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000402786d7/0x5d1142b832482121 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823620.974432:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000402786d7/0x5d1142b832482121 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823620.974455:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000402786d7/0x5d1142b832482121 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823620.974465:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000402786d7/0x5d1142b832482121 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823620.974473:0:6686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000402786d7/0x5d1142b832482121 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823620.974480:0:6686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40f800 already unused, calling callback (ffffffffc1649440) 00010000:00010000:3.0:1787823620.974483:0:6686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000402786d7/0x5d1142b832482121 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823620.974491:0:6686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000402786d7/0x5d1142b832482121 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823620.974503:0:6686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000402786d7/0x5d1142b832482121 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823620.974511:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000402786d7/0x5d1142b832482121 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823620.974571:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec64780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+7:2353:x1874668629854720:12345-192.168.202.35@tcp:1:lfs.0 Request processed in 13319us (13511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823620.974589:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 49 00000100:00100000:0.0:1787823620.981885:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823620.982101:0:12014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629855232 00000100:00100000:3.0:1787823620.982111:0:12014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629855232 00000100:00100000:3.0:1787823620.982185:0:12014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 38 00000100:00100000:3.0:1787823620.982196:0:12014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7925a90050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:353832f0-fe7b-4d99-975c-a8041babed42+24:11362:x1874668629855232:12345-192.168.202.35@tcp:35:lfs.0 00000004:00010000:3.0:1787823620.982261:0:12014:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832482113 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44902 expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787823620.982657:0:12014:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1787823620.982703:0:12014:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:3.0:1787823620.983696:0:12014:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:3.0:1787823620.983789:0:12014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ca00/0x5d1142b832482128 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823620.983808:0:12014:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324820bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448d8 expref: 28 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823620.983817:0:12014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ca00/0x5d1142b832482128 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823620.984092:0:12014:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324820bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448d8 expref: 28 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823620.984114:0:12014:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324820bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448d8 expref: 28 pid: 7893 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823620.984144:0:12014:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec66d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:12014:1874668651881600:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787823620.984491:0:12014:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908f8c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787823620.989640:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823620.989898:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629855360 00000100:00100000:1.0:1787823620.989925:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629855360 00010000:00010000:1.0:1787823620.989980:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324820bf lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448d8 expref: 29 pid: 7893 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823620.990025:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 62 00000100:00100000:1.0:1787823620.990035:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939dfbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:353832f0-fe7b-4d99-975c-a8041babed42+29:2352:x1874668629855360:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787823620.990051:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823620.990058:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324820bf lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448d8 expref: 29 pid: 7893 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.990072:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324820bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448d8 expref: 29 pid: 7893 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.990095:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228da100) 00010000:00010000:1.0:1787823620.990102:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ca00/0x5d1142b832482128 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.990112:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ca00/0x5d1142b832482128 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.990120:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ca00/0x5d1142b832482128 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823620.990141:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823620.990214:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939dfbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:353832f0-fe7b-4d99-975c-a8041babed42+29:2352:x1874668629855360:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 180us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823620.990223:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 62 00010000:00010000:3.0:1787823620.991267:0:12014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324820bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448d8 expref: 28 pid: 7893 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823620.991289:0:12014:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec66d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:12014:1874668651881600:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787823620.991371:0:12014:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ca00/0x5d1142b832482128 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823620.991382:0:12014:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ca00/0x5d1142b832482128 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823620.991388:0:12014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ca00/0x5d1142b832482128 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12014 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787823620.991509:0:12014:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:3.0:1787823620.992279:0:12014:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1787823620.992537:0:12014:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec66d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12014:1874668651881728:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787823620.992633:0:12014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823620.992708:0:12014:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908f8cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787823620.993686:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651881728 00000100:00100000:0.0:1787823620.993697:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651881728 00000100:00100000:0.0:1787823620.994137:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787823620.994149:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922b88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:12014:x1874668651881728:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1787823620.994270:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922b88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:12014:x1874668651881728:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 124us (1638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823620.994278:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787823620.994350:0:12014:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec66d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12014:1874668651881728:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1787823620.994898:0:12014:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:3.0:1787823620.994994:0:12014:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec66d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12014:1874668651881856:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787823620.995057:0:12014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823620.996398:0:12014:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908f8c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787823620.996460:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651881856 00000100:00100000:2.0:1787823620.996471:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651881856 00000100:00100000:2.0:1787823620.997458:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787823620.997481:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12014:x1874668651881856:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787823620.998676:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:12014:x1874668651881856:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 1199us (3614us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787823620.998687:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787823620.999069:0:12014:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec66d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12014:1874668651881856:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1787823620.999558:0:12014:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1787823620.999625:0:12014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ca00/0x5d1142b832482128 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.999637:0:12014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ca00/0x5d1142b832482128 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.999646:0:12014:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ca00/0x5d1142b832482128 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.999663:0:12014:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26ca00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823620.999668:0:12014:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ca00/0x5d1142b832482128 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.999677:0:12014:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ca00/0x5d1142b832482128 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.999692:0:12014:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228da100) 00010000:00010000:2.0:1787823620.999695:0:12014:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787823620.999700:0:12014:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ca00/0x5d1142b832482128 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823620.999706:0:12014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ca00/0x5d1142b832482128 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12014 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787823621.000474:0:12014:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787823621.000656:0:12014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1787823621.000671:0:12014:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 361854911355ns, next at 362854908452ns, rc = 0 00000001:00080000:2.0:1787823621.000679:0:12014:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:2.0:1787823621.000731:0:12014:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228da100) 00010000:00010000:2.0:1787823621.000735:0:12014:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787823621.000745:0:12014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b832482113 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44902 expref: 32 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823621.001461:0:12014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7925a90050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:353832f0-fe7b-4d99-975c-a8041babed42+31:11362:x1874668629855232:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 19265us (19583us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1787823621.001473:0:12014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 38 00000020:00080000:2.0:1787823621.001478:0:12014:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787823621.005376:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823621.005461:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629855488 00000100:00100000:2.0:1787823621.005470:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629855488 00000100:00100000:2.0:1787823621.005531:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 148 00000100:00100000:2.0:1787823621.005541:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939dfb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+31:11362:x1874668629855488:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:2.0:1787823621.005566:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823621.005598:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b83248212f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44909 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.005658:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b83248212f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44909 expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.005673:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b83248212f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44909 expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.005691:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228dad00) 00010000:00010000:2.0:1787823621.005695:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787823621.005699:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d3400, rc 0) 00000100:00100000:2.0:1787823621.005792:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939dfb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+32:11362:x1874668629855488:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 252us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823621.005800:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 148 00000100:00100000:0.0:1787823621.010139:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823621.010311:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629855744 00000100:00100000:1.0:1787823621.010321:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629855744 00000100:00100000:1.0:1787823621.010398:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 39 00000100:00100000:1.0:1787823621.010410:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939dfa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+32:11362:x1874668629855744:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:1.0:1787823621.010661:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939dfa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+33:11362:x1874668629855744:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 253us (533us total) trans 4294967433 rc 0/0 00000100:00100000:1.0:1787823621.010669:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 39 00000100:00100000:0.0:1787823621.114138:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823621.114862:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629856000 00000100:00100000:3.0:1787823621.114874:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629856000 00000100:00100000:3.0:1787823621.114958:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 149 00000100:00100000:3.0:1787823621.114970:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939df9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+33:11372:x1874668629856000:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:3.0:1787823621.114995:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823621.115015:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26cc00/0x5d1142b832482136 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44910 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787823621.115126:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787823621.115254:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26cc00/0x5d1142b832482136 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44910 expref: 35 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823621.115268:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e791767ba00) 00010000:00010000:3.0:1787823621.115271:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787823621.115277:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26cc00/0x5d1142b832482136 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44910 expref: 35 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823621.115292:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a26cc00, rc 0) 00000100:00100000:3.0:1787823621.115376:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939df9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+34:11372:x1874668629856000:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 408us (1247us total) trans 4294967434 rc 301/301 00000100:00100000:3.0:1787823621.115384:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 149 00000100:00100000:0.0:1787823621.128904:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823621.129090:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629856128 00000100:00100000:2.0:1787823621.129100:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629856128 00000100:00100000:2.0:1787823621.129153:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 150 00000100:00100000:2.0:1787823621.129162:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939dfa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+34:11372:x1874668629856128:12345-192.168.202.35@tcp:34:lfs.0 00010000:00010000:2.0:1787823621.129238:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832482144 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.129256:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832482144 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.129277:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832482144 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.129292:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b83248214b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.129310:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b83248214b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.129318:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b83248214b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.129437:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482152 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.129446:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482152 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.129452:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482152 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787823621.129493:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482152 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.129506:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832482144 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.129512:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832482144 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.129519:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832482144 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.129536:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d2200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823621.129540:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832482144 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.129546:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832482144 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.129569:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e7917859e00) 00010000:00010000:2.0:1787823621.129572:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823621.129583:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832482144 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.129590:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b832482144 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.129604:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b83248214b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.129610:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b83248214b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.129616:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b83248214b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.129622:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d2a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823621.129624:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b83248214b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.129630:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b83248214b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.129647:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e79228da100) 00010000:00010000:2.0:1787823621.129650:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823621.129653:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b83248214b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.129659:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b83248214b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.129674:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482152 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.129680:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482152 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.129686:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482152 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.129691:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823621.129694:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482152 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.129699:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482152 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.129706:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228dad00) 00010000:00010000:2.0:1787823621.129709:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823621.129712:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482152 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.129718:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482152 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823621.129866:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939dfa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+34:11372:x1874668629856128:12345-192.168.202.35@tcp:34:lfs.0 Request processed in 703us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823621.129874:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 150 00000100:00100000:1.0:1787823621.132911:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823621.132945:0:12014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629856384 00000100:00100000:2.0:1787823621.132958:0:12014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629856384 00000100:00100000:2.0:1787823621.133026:0:12014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 40 00000100:00100000:2.0:1787823621.133046:0:12014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fd52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:353832f0-fe7b-4d99-975c-a8041babed42+34:11372:x1874668629856384:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:2.0:1787823621.133338:0:12014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fd52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:353832f0-fe7b-4d99-975c-a8041babed42+35:11372:x1874668629856384:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 302us (437us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1787823621.133346:0:12014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 40 00000100:00100000:0.0:1787823621.203539:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823621.205469:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629856640 00000100:00100000:3.0:1787823621.205486:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629856640 00000100:00100000:3.0:1787823621.205564:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 151 00000100:00100000:3.0:1787823621.205586:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939df83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+35:11375:x1874668629856640:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:3.0:1787823621.205613:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823621.205651:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26cc00/0x5d1142b832482159 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44917 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823621.205742:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c600/0x5d1142b832482160 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823621.205781:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c600/0x5d1142b832482160 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823621.205795:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c600/0x5d1142b832482160 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823621.205809:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b832482167 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823621.205817:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b832482167 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823621.205823:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b832482167 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823621.206080:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b83248216e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823621.206089:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b83248216e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823621.206097:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b83248216e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787823621.206108:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787823621.206209:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c600/0x5d1142b832482160 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823621.206227:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c600/0x5d1142b832482160 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823621.206234:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c600/0x5d1142b832482160 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823621.206240:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26c600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823621.206244:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c600/0x5d1142b832482160 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823621.206251:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c600/0x5d1142b832482160 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823621.206264:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e7917859e00) 00010000:00010000:3.0:1787823621.206267:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787823621.206272:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c600/0x5d1142b832482160 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823621.206279:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c600/0x5d1142b832482160 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823621.206294:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b832482167 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823621.206312:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b832482167 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823621.206318:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b832482167 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823621.206322:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26d600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823621.206330:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b832482167 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823621.206336:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b832482167 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823621.206343:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e79087c9700) 00010000:00010000:3.0:1787823621.206345:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787823621.206348:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b832482167 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823621.206353:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b832482167 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823621.206397:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26cc00/0x5d1142b832482159 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44917 expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823621.206411:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b83248216e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44917 expref: 37 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823621.206418:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228dad00) 00010000:00010000:3.0:1787823621.206421:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787823621.206423:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a26de00, rc 0) 00000100:00100000:3.0:1787823621.206614:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939df83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+37:11375:x1874668629856640:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 1039us (3087us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1787823621.206622:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 151 00000100:00100000:0.0:1787823621.210086:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823621.210180:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629856768 00000100:00100000:1.0:1787823621.210189:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629856768 00000100:00100000:1.0:1787823621.210246:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 152 00000100:00100000:1.0:1787823621.210257:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939df92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+37:11375:x1874668629856768:12345-192.168.202.35@tcp:54:lfs.0 00010000:00010000:1.0:1787823621.210386:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b83248217c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823621.210403:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b83248217c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823621.210414:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b83248217c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823621.210437:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b83248217c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823621.210443:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b83248217c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823621.210450:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b83248217c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823621.210456:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f2a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823621.210460:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b83248217c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823621.210480:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b83248217c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823621.210494:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228dad00) 00010000:00010000:1.0:1787823621.210497:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787823621.210502:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b83248217c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823621.210509:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b83248217c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823621.210622:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939df92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+37:11375:x1874668629856768:12345-192.168.202.35@tcp:54:lfs.0 Request processed in 365us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823621.210630:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 152 00000100:00100000:1.0:1787823621.214634:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823621.215210:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629857024 00000100:00100000:2.0:1787823621.215220:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629857024 00000100:00100000:2.0:1787823621.215315:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 41 00000100:00100000:2.0:1787823621.215326:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+37:11375:x1874668629857024:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:2.0:1787823621.215568:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+38:11375:x1874668629857024:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 243us (942us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1787823621.215601:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 41 00010000:00010000:0.0:1787823621.355562:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823621.610611:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787823621.610637:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a03e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651881984:0@lo:400:kworker.0 00000100:00100000:3.0:1787823621.610707:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823621.613441:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a03cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874668651882112:0@lo:400:kworker.0 00000100:00100000:2.0:1787823621.613514:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823621.615352:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651881984 00000100:00100000:1.0:1787823621.615367:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651881984 00000100:00100000:1.0:1787823621.615440:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1787823621.615451:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3305:x1874668651881984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823621.615686:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651882112 00000100:00100000:3.0:1787823621.615691:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651882112 00000100:00100000:3.0:1787823621.615743:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787823621.615751:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874668651882112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823621.616084:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a76cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874668651882496:0@lo:400:kworker.0 00000100:00100000:1.0:1787823621.616361:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3305:x1874668651881984:12345-0@lo:400:kworker.0 Request processed in 911us (5653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823621.616368:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1787823621.616436:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793f99b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874668651882240:0@lo:400:kworker.0 00000100:00100000:1.0:1787823621.616465:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823621.616514:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651882368:0@lo:400:kworker.0 00000100:00100000:1.0:1787823621.616554:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823621.616600:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a03e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651881984:0@lo:400:kworker.0 00000100:00100000:1.0:1787823621.616638:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651882368 00000100:00100000:1.0:1787823621.616642:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651882368 00000100:00100000:1.0:1787823621.616683:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787823621.616690:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fd5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1874668651882368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823621.616738:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fd5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1874668651882368:12345-0@lo:400:kworker.0 Request processed in 48us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823621.616747:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1787823621.616780:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787823621.616802:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651882368:0@lo:400:kworker.0 00000100:00100000:1.0:1787823621.616828:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651882240 00000100:00100000:1.0:1787823621.616831:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651882240 00000100:00100000:1.0:1787823621.616875:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787823621.616882:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874668651882240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823621.616916:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874668651882240:12345-0@lo:400:kworker.0 Request processed in 36us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823621.616923:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:1.0:1787823621.616935:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787823621.616950:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793f99b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874668651882240:0@lo:400:kworker.0 00000100:00100000:3.0:1787823621.626739:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874668651882112:12345-0@lo:400:kworker.0 Request processed in 10964us (13199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823621.626771:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787823621.627048:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823621.627275:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a03cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874668651882112:0@lo:400:kworker.0 00000100:00100000:2.0:1787823621.627287:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792e80de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651882624:0@lo:400:kworker.0 00000100:00100000:2.0:1787823621.627396:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823621.627491:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651882496 00000100:00100000:1.0:1787823621.627499:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651882496 00000100:00100000:3.0:1787823621.627524:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651882624 00000100:00100000:1.0:1787823621.627578:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787823621.627588:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939dfad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874668651882496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823621.627616:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651882624 00000100:00100000:1.0:1787823621.627647:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939dfad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874668651882496:12345-0@lo:400:kworker.0 Request processed in 60us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823621.627654:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787823621.627659:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787823621.627669:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651882624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823621.627803:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651882624:12345-0@lo:400:kworker.0 Request processed in 136us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823621.627811:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:0.0:1787823621.627876:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787823621.627881:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787823621.627946:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a76cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874668651882496:0@lo:400:kworker.0 00000100:00100000:1.0:1787823621.628243:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792e80de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651882624:0@lo:400:kworker.0 00000100:00100000:3.0:1787823621.729702:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823621.730262:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629857280 00000100:00100000:1.0:1787823621.730274:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629857280 00000100:00100000:1.0:1787823621.730341:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 153 00000100:00100000:1.0:1787823621.730352:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+38:11406:x1874668629857280:12345-192.168.202.35@tcp:101:cat.0 00010000:00010000:1.0:1787823621.730390:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823621.730411:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832482183 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f4491e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823621.730517:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248218a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823621.730533:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248218a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823621.730545:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248218a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787823621.730557:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787823621.730684:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832482183 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4491e expref: 41 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823621.730703:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248218a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4491e expref: 40 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823621.730713:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228dad00) 00010000:00010000:1.0:1787823621.730716:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787823621.730720:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a2f2e00, rc 0) 00000100:00100000:1.0:1787823621.730827:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+40:11406:x1874668629857280:12345-192.168.202.35@tcp:101:cat.0 Request processed in 476us (1134us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1787823621.730851:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 153 00000100:00100000:0.0:1787823621.739101:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823621.739143:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823621.739216:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629857408 00000100:00100000:3.0:1787823621.739227:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629857408 00000100:00100000:3.0:1787823621.739294:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 12 00000100:00100000:3.0:1787823621.739305:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939df8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:353832f0-fe7b-4d99-975c-a8041babed42+40:2353:x1874668629857408:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787823621.739321:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787823621.739347:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248218a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4491e expref: 40 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823621.739368:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228dad00) 00010000:00010000:3.0:1787823621.739373:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787823621.739529:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939df8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:353832f0-fe7b-4d99-975c-a8041babed42+39:2353:x1874668629857408:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 226us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823621.739553:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 12 00000100:00100000:1.0:1787823621.740374:0:12014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629857664 00000100:00100000:1.0:1787823621.740383:0:12014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629857664 00000100:00100000:1.0:1787823621.740429:0:12014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 42 00000100:00100000:1.0:1787823621.740437:0:12014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939dfa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:353832f0-fe7b-4d99-975c-a8041babed42+39:11406:x1874668629857664:12345-192.168.202.35@tcp:35:cat.0 00000100:00100000:1.0:1787823621.740685:0:12014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939dfa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:353832f0-fe7b-4d99-975c-a8041babed42+40:11406:x1874668629857664:12345-192.168.202.35@tcp:35:cat.0 Request processed in 248us (1540us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1787823621.740692:0:12014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 42 00000100:00100000:0.0:1787823621.797631:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823621.798863:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629857920 00000100:00100000:1.0:1787823621.798876:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629857920 00000100:00100000:1.0:1787823621.798953:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 154 00000100:00100000:1.0:1787823621.798962:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939df8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+40:11412:x1874668629857920:12345-192.168.202.35@tcp:101:dd.0 00010000:00010000:1.0:1787823621.798986:0:7893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823621.798989:0:7893:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787823621.799016:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b8324820f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448f4 expref: 40 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823621.799040:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e7917859e00) 00010000:00010000:1.0:1787823621.799045:0:7893:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787823621.799057:0:7893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832482198 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44925 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823621.799152:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248219f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823621.799164:0:7893:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b83248216e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44917 expref: 40 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823621.799187:0:7893:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248219f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823621.799222:0:7893:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b83248216e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44917 expref: 40 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823621.799232:0:7893:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b83248216e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44917 expref: 40 pid: 5839 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823621.799245:0:7893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7906fd7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7893:1874668651882752:192.168.202.35@tcp:104: 00000100:00100000:1.0:1787823621.799362:0:7893:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e790bdbe000 going to sleep for 11 seconds 00000100:00100000:1.0:1787823621.805969:0:7893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7906fd7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7893:1874668651882752:192.168.202.35@tcp:104: 00010000:00010000:1.0:1787823621.806001:0:7893:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248219f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823621.811908:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823621.812209:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629858048 00000100:00100000:2.0:1787823621.812235:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629858048 00010000:00010000:2.0:1787823621.812276:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b83248216e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44917 expref: 41 pid: 5839 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823621.812319:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 63 00000100:00100000:2.0:1787823621.812328:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79037f2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:353832f0-fe7b-4d99-975c-a8041babed42+41:2353:x1874668629858048:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787823621.812342:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787823621.812349:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b83248216e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44917 expref: 41 pid: 5839 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.812363:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b83248216e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44917 expref: 41 pid: 5839 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.812403:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b83248216e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44917 expref: 41 pid: 5839 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.812423:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228dad00) 00010000:00010000:2.0:1787823621.812428:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248219f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.812437:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248219f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.812446:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248219f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.812477:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787823621.812873:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79037f2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:353832f0-fe7b-4d99-975c-a8041babed42+40:2353:x1874668629858048:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 544us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823621.812892:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 63 00010000:00010000:0.0:1787823621.813043:0:7893:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248219f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823621.813052:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248219f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787823621.813072:0:7893:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787823621.813238:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b832482198 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44925 expref: 41 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823621.813255:0:7893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248219f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44925 expref: 40 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823621.813264:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228dad00) 00010000:00010000:0.0:1787823621.813268:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787823621.813270:0:7893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a2f2e00, rc 0) 00000100:00100000:0.0:1787823621.813297:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939df8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+40:11412:x1874668629857920:12345-192.168.202.35@tcp:101:dd.0 Request processed in 14336us (15678us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1787823621.813305:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 154 00000100:00100000:0.0:1787823621.817880:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823621.818166:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629858304 00000100:00100000:3.0:1787823621.818175:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629858304 00000100:00100000:3.0:1787823621.818239:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 155 00000100:00100000:3.0:1787823621.818250:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939df9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+40:11412:x1874668629858304:12345-192.168.202.35@tcp:36:dd.0 00010000:00010000:3.0:1787823621.819025:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26cc00/0x5d1142b8324821ad lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823621.819047:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26cc00/0x5d1142b8324821ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823621.819059:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26cc00/0x5d1142b8324821ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787823621.819114:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:3.0:1787823621.819140:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000862195e0 reply state 000000002e0235f7 transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26cc00/0x5d1142b8324821ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823621.819149:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787823621.819291:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939df9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+43:11412:x1874668629858304:12345-192.168.202.35@tcp:36:dd.0 Request processed in 1039us (1417us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1787823621.819310:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 155 00000020:00080000:3.0:1787823621.819317:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787823621.834693:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26cc00/0x5d1142b8324821ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.834713:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26cc00/0x5d1142b8324821ad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.834722:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26cc00/0x5d1142b8324821ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.834728:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26cc00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823621.834733:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26cc00/0x5d1142b8324821ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.834740:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26cc00/0x5d1142b8324821ad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.834773:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228dad00) 00010000:00010000:2.0:1787823621.834777:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823621.834781:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26cc00/0x5d1142b8324821ad lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823621.834788:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26cc00/0x5d1142b8324821ad lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823622.122854:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792e80de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651882880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787823622.122933:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823622.123065:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651882880 00000100:00100000:0.0:1787823622.123072:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651882880 00000100:00100000:0.0:1787823622.123129:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787823622.123140:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793628b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651882880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787823622.123174:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787823622.123218:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793628b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651882880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823622.123226:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787823622.124218:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792e80de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651882880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787823622.127252:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823622.127282:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629858432 00000100:00100000:2.0:1787823622.127291:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629858432 00000100:00100000:2.0:1787823622.127365:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 156 00000100:00100000:2.0:1787823622.127376:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939df8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+42:11426:x1874668629858432:12345-192.168.202.35@tcp:101:stat.0 00000100:00080000:0.0:1787823622.127390:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787823622.127399:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823622.127434:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b8324821b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f4492c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823622.127506:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b8324821bb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823622.128552:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b8324821bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823622.128575:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b8324821bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823622.128597:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324821c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823622.128604:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324821c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823622.128610:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324821c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.128878:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b8324821c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.128892:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248219f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44925 expref: 43 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.128917:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b8324821c9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.128957:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248219f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44925 expref: 43 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.128971:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248219f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44925 expref: 43 pid: 7893 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823622.128985:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a2ec780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1874668651883008:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787823622.129076:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908f8c180 going to sleep for 11 seconds 00000100:00100000:0.0:1787823622.132331:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823622.132579:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a2ec780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1874668651883008:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787823622.132609:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b8324821c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823622.132714:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629858688 00000100:00100000:2.0:1787823622.132720:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629858688 00000100:00100000:2.0:1787823622.132781:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 43 00000100:00100000:2.0:1787823622.132791:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+44:5592:x1874668629858688:12345-192.168.202.35@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787823622.133108:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+45:5592:x1874668629858688:12345-192.168.202.35@tcp:35:ldlm_bl.0 Request processed in 317us (785us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1787823622.133117:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 43 00000100:00100000:0.0:1787823622.137247:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823622.137336:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629858816 00000100:00100000:2.0:1787823622.137346:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629858816 00010000:00010000:2.0:1787823622.137385:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248219f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44925 expref: 45 pid: 7893 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823622.137444:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 64 00000100:00100000:2.0:1787823622.137454:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939df8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:353832f0-fe7b-4d99-975c-a8041babed42+45:2354:x1874668629858816:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787823622.137470:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787823622.137477:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248219f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44925 expref: 45 pid: 7893 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823622.137490:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248219f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44925 expref: 45 pid: 7893 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823622.137513:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b83248219f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44925 expref: 45 pid: 7893 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823622.137527:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228dad00) 00010000:00010000:2.0:1787823622.137531:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b8324821c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823622.137540:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b8324821c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823622.137547:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b8324821c9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823622.137669:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787823622.137740:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939df8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:353832f0-fe7b-4d99-975c-a8041babed42+44:2354:x1874668629858816:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 287us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823622.137748:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 64 00010000:00010000:3.0:1787823622.144077:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b8324821c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.144099:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b8324821c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787823622.144159:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787823622.144163:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787823622.144196:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b8324821c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.144213:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b8324821c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.144241:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b8324821bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.144247:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b8324821bb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.144254:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b8324821bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.144260:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d2200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823622.144265:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b8324821bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.144272:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b8324821bb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.144302:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e7917859e00) 00010000:00010000:3.0:1787823622.144305:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787823622.144310:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b8324821bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.144316:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b8324821bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.144331:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324821c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.144342:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324821c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.144348:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324821c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.144358:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823622.144361:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324821c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.144367:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324821c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.144381:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e79228da100) 00010000:00010000:3.0:1787823622.144384:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787823622.144387:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324821c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.144394:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324821c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.144444:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b8324821b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4492c expref: 44 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.144461:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b8324821c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4492c expref: 43 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.144469:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228dad00) 00010000:00010000:3.0:1787823622.144471:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787823622.144473:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a26d600, rc 0) 00000100:00100000:3.0:1787823622.144977:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939df8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+43:11426:x1874668629858432:12345-192.168.202.35@tcp:101:stat.0 Request processed in 17600us (17732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823622.144987:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 156 00000100:00100000:0.0:1787823622.220824:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823622.220925:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629859072 00000100:00100000:1.0:1787823622.220937:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629859072 00000100:00100000:1.0:1787823622.220996:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 157 00000100:00100000:1.0:1787823622.221007:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939dfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+43:11432:x1874668629859072:12345-192.168.202.35@tcp:36:truncate.0 00010000:00010000:1.0:1787823622.221062:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823622.221090:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b8324821c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4492c expref: 43 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.221129:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228dad00) 00010000:00010000:1.0:1787823622.221135:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787823622.221339:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b8324821d0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.221353:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b8324821d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.221363:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b8324821d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787823622.221429:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:1.0:1787823622.221455:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000db9e3a53 reply state 0000000071df7877 transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b8324821d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823622.221463:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787823622.221563:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939dfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+45:11432:x1874668629859072:12345-192.168.202.35@tcp:36:truncate.0 Request processed in 558us (749us total) trans 4294967445 rc 0/0 00000100:00100000:1.0:1787823622.221579:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 157 00000020:00080000:1.0:1787823622.221584:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787823622.222911:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b8324821d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.222926:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b8324821d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.222932:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b8324821d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.222938:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f2200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823622.222953:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b8324821d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.222961:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b8324821d0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.222974:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228dad00) 00010000:00010000:1.0:1787823622.222976:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823622.222980:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b8324821d0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.222985:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b8324821d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823622.377991:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823622.421257:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823622.421376:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629859200 00000100:00100000:1.0:1787823622.421387:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629859200 00000100:00100000:1.0:1787823622.421450:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 158 00000100:00100000:1.0:1787823622.421460:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939df9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+44:11446:x1874668629859200:12345-192.168.202.35@tcp:101:stat.0 00010000:00010000:1.0:1787823622.421496:0:7893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823622.421516:0:7893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b8324821d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44933 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.421613:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b8324821de lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.421628:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b8324821de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.421650:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b8324821de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.421666:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b8324821e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.421680:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b8324821e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.421687:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b8324821e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.421838:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b8324821ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.421847:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b8324821ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.421854:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b8324821ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787823622.421888:0:7893:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1787823622.421892:0:7893:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787823622.421909:0:7893:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b8324821ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.421920:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b8324821ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.421929:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b8324821de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.421936:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b8324821de lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.421942:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b8324821de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.421957:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f2e00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823622.421962:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b8324821de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.421970:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b8324821de lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.421982:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e7917859e00) 00010000:00010000:1.0:1787823622.421985:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823622.421990:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b8324821de lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.421996:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2e00/0x5d1142b8324821de lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.422009:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b8324821e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.422015:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b8324821e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.422022:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b8324821e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.422027:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f2a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823622.422030:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b8324821e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.422037:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b8324821e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.422053:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e7917859300) 00010000:00010000:1.0:1787823622.422056:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823622.422059:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b8324821e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.422065:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2a00/0x5d1142b8324821e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.422096:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2200/0x5d1142b8324821d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44933 expref: 46 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.422109:0:7893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b8324821ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44933 expref: 45 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.422116:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228dad00) 00010000:00010000:1.0:1787823622.422119:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787823622.422121:0:7893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7920eea400, rc 0) 00000100:00100000:1.0:1787823622.422188:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939df9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+45:11446:x1874668629859200:12345-192.168.202.35@tcp:101:stat.0 Request processed in 728us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823622.422195:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 158 00000100:00100000:0.0:1787823622.568243:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823622.570097:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629859456 00000100:00100000:1.0:1787823622.570115:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629859456 00000100:00100000:1.0:1787823622.570197:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 159 00000100:00100000:1.0:1787823622.570209:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939dfbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+45:11456:x1874668629859456:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:1.0:1787823622.570236:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823622.570263:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b8324821f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f4493a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787823622.570447:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787823622.570605:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b8324821f3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4493a expref: 47 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.570621:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e791767ba00) 00010000:00010000:1.0:1787823622.570624:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787823622.570630:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b8324821f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4493a expref: 47 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.570648:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7920eeac00, rc 0) 00000100:00100000:1.0:1787823622.570727:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939dfbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+46:11456:x1874668629859456:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 519us (2495us total) trans 4294967446 rc 301/301 00000100:00100000:1.0:1787823622.570735:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 159 00000100:00100000:0.0:1787823622.577155:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823622.577384:0:12014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629859712 00000100:00100000:1.0:1787823622.577394:0:12014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629859712 00000100:00100000:1.0:1787823622.577441:0:12014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 44 00000100:00100000:1.0:1787823622.577452:0:12014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7925a90850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:353832f0-fe7b-4d99-975c-a8041babed42+46:11456:x1874668629859712:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:1.0:1787823622.578394:0:12014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7925a90850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:353832f0-fe7b-4d99-975c-a8041babed42+47:11456:x1874668629859712:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 939us (1244us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1787823622.578404:0:12014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 44 00000100:00100000:3.0:1787823622.762177:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823622.762444:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629859968 00000100:00100000:1.0:1787823622.762458:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629859968 00000100:00100000:1.0:1787823622.762533:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 160 00000100:00100000:1.0:1787823622.762545:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+47:11462:x1874668629859968:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:1.0:1787823622.762599:0:7893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823622.762633:0:7893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832482201 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44941 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.762854:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832482208 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.762870:0:7893:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b8324821ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44933 expref: 48 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.762878:0:7893:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832482208 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.762920:0:7893:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b8324821ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44933 expref: 48 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.762935:0:7893:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b8324821ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44933 expref: 48 pid: 7893 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823622.762949:0:7893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7906fd52c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7893:1874668651883136:192.168.202.35@tcp:104: 00000100:00100000:1.0:1787823622.763060:0:7893:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e790bdbe6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787823622.767268:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823622.767339:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629860096 00000100:00100000:3.0:1787823622.767349:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629860096 00010000:00010000:3.0:1787823622.767396:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b8324821ec lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44933 expref: 49 pid: 7893 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823622.767439:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 65 00000100:00100000:3.0:1787823622.767446:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939df8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:353832f0-fe7b-4d99-975c-a8041babed42+49:2352:x1874668629860096:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787823622.767462:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787823622.767470:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b8324821ec lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44933 expref: 49 pid: 7893 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.767482:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b8324821ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44933 expref: 49 pid: 7893 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.767503:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228dad00) 00010000:00010000:3.0:1787823622.767507:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832482208 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.767515:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832482208 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.767520:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832482208 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.767535:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787823622.767729:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b8324821ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44933 expref: 49 pid: 7893 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823622.767752:0:7893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7906fd52c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7893:1874668651883136:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787823622.767947:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939df8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:353832f0-fe7b-4d99-975c-a8041babed42+48:2352:x1874668629860096:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 499us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823622.767956:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 65 00010000:00010000:1.0:1787823622.768308:0:7893:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832482208 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.768317:0:7893:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832482208 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.768338:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832482208 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787823622.768358:0:7893:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1787823622.768526:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832482201 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44941 expref: 49 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.768538:0:7893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832482208 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44941 expref: 48 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.768543:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228dad00) 00010000:00010000:1.0:1787823622.768546:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787823622.768548:0:7893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7920eea600, rc 0) 00000100:00100000:1.0:1787823622.768594:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+48:11462:x1874668629859968:12345-192.168.202.35@tcp:101:bash.0 Request processed in 6052us (6431us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1787823622.768599:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 160 00000100:00100000:0.0:1787823622.771377:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823622.771459:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629860352 00000100:00100000:1.0:1787823622.771468:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629860352 00000100:00100000:1.0:1787823622.771541:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 161 00000100:00100000:1.0:1787823622.771548:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939dfa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+48:11462:x1874668629860352:12345-192.168.202.35@tcp:36:bash.0 00010000:00010000:1.0:1787823622.772153:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482216 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.772167:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482216 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.772175:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482216 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787823622.772232:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:1.0:1787823622.772249:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d77ed5ce reply state 000000005c1ea2cf transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482216 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823622.772254:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787823622.772452:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939dfa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+51:11462:x1874668629860352:12345-192.168.202.35@tcp:36:bash.0 Request processed in 902us (1085us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1787823622.772458:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 161 00000020:00080000:1.0:1787823622.772461:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787823622.775522:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482216 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.775576:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482216 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.775585:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482216 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.775591:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eebc00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823622.775595:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482216 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.775603:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482216 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.775620:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228dad00) 00010000:00010000:3.0:1787823622.775623:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787823622.775627:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482216 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.775633:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482216 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823622.778007:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823622.778059:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629860480 00000100:00100000:3.0:1787823622.778069:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629860480 00000100:00100000:3.0:1787823622.778133:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 162 00000100:00100000:3.0:1787823622.778144:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939dfa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+50:11462:x1874668629860480:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:3.0:1787823622.778174:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823622.778197:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c600/0x5d1142b83248221d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44948 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.778282:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c400/0x5d1142b832482224 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.778305:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832482208 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44941 expref: 51 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.778313:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c400/0x5d1142b832482224 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.778359:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832482208 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44941 expref: 51 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.778374:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832482208 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44941 expref: 51 pid: 7893 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823622.778389:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a2ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1874668651883264:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787823622.778485:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908f8c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787823622.781835:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a2ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1874668651883264:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787823622.781888:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c400/0x5d1142b832482224 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823622.782237:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823622.782640:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629860608 00000100:00100000:2.0:1787823622.782667:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629860608 00010000:00010000:2.0:1787823622.782723:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832482208 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44941 expref: 52 pid: 7893 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823622.783390:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 66 00000100:00100000:2.0:1787823622.783407:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939dfb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:353832f0-fe7b-4d99-975c-a8041babed42+52:2353:x1874668629860608:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787823622.783425:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787823622.783433:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832482208 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44941 expref: 52 pid: 7893 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823622.783450:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832482208 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44941 expref: 52 pid: 7893 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823622.783476:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832482208 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44941 expref: 52 pid: 7893 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823622.783505:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228dad00) 00010000:00010000:2.0:1787823622.783511:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c400/0x5d1142b832482224 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823622.783521:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c400/0x5d1142b832482224 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823622.783530:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c400/0x5d1142b832482224 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823622.783576:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787823622.783640:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939dfb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:353832f0-fe7b-4d99-975c-a8041babed42+51:2353:x1874668629860608:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 239us (1404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823622.783659:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 66 00010000:00010000:1.0:1787823622.783723:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c400/0x5d1142b832482224 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.783731:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c400/0x5d1142b832482224 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787823622.783811:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787823622.783816:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787823622.783840:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c400/0x5d1142b832482224 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.783883:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c600/0x5d1142b83248221d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44948 expref: 51 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.783900:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c400/0x5d1142b832482224 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44948 expref: 50 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.783907:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228dad00) 00010000:00010000:1.0:1787823622.783910:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787823622.783912:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a26c400, rc 0) 00000100:00100000:1.0:1787823622.783945:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939dfa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+50:11462:x1874668629860480:12345-192.168.202.35@tcp:101:bash.0 Request processed in 5804us (5948us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823622.783952:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 162 00000100:00100000:2.0:1787823622.787616:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823622.787754:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629860864 00000100:00100000:3.0:1787823622.788064:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629860864 00000100:00100000:3.0:1787823622.788154:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 45 00000100:00100000:3.0:1787823622.788163:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+50:11462:x1874668629860864:12345-192.168.202.35@tcp:35:bash.0 00000100:00100000:3.0:1787823622.788399:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+51:11462:x1874668629860864:12345-192.168.202.35@tcp:35:bash.0 Request processed in 236us (793us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1787823622.788406:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 45 00000100:00100000:0.0:1787823622.903128:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823622.903224:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629861120 00000100:00100000:3.0:1787823622.903252:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629861120 00000100:00100000:3.0:1787823622.903327:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 163 00000100:00100000:3.0:1787823622.903336:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ac84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+51:11472:x1874668629861120:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:3.0:1787823622.903370:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823622.903392:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b83248222b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f4494f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787823622.903516:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787823622.903649:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b83248222b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4494f expref: 53 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.903667:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e791767ba00) 00010000:00010000:3.0:1787823622.903671:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787823622.903678:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b83248222b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4494f expref: 53 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823622.903700:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a26dc00, rc 0) 00000100:00100000:3.0:1787823622.904551:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ac84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+52:11472:x1874668629861120:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 1211us (1430us total) trans 4294967452 rc 301/301 00000100:00100000:3.0:1787823622.904576:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 163 00000100:00100000:1.0:1787823622.912317:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823622.912526:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629861248 00000100:00100000:0.0:1787823622.912537:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629861248 00000100:00100000:0.0:1787823622.912626:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 164 00000100:00100000:0.0:1787823622.912638:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fd52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+52:11472:x1874668629861248:12345-192.168.202.35@tcp:34:lfs.0 00010000:00010000:0.0:1787823622.912749:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482239 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823622.912817:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482239 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823622.912830:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482239 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823622.912848:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482240 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823622.912866:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482240 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823622.912873:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482240 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823622.912987:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832482247 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823622.913014:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832482247 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823622.913022:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832482247 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787823622.913069:0:7893:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832482247 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823622.913082:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482239 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823622.913091:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482239 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823622.913098:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482239 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823622.913103:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40ec00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823622.913107:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482239 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823622.913115:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482239 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823622.913126:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e7917859e00) 00010000:00010000:0.0:1787823622.913128:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823622.913134:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482239 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823622.913139:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482239 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823622.913161:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482240 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823622.913168:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482240 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823622.913175:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482240 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823622.913181:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40f600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823622.913184:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482240 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823622.913191:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482240 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823622.913200:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e791767be00) 00010000:00010000:0.0:1787823622.913202:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823622.913205:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482240 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823622.913211:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482240 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823622.913224:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832482247 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823622.913230:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832482247 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823622.913235:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832482247 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823622.913247:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40e600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823622.913250:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832482247 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823622.913256:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832482247 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823622.913264:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228dad00) 00010000:00010000:0.0:1787823622.913267:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823622.913270:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832482247 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823622.913275:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b832482247 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823622.913363:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fd52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+52:11472:x1874668629861248:12345-192.168.202.35@tcp:34:lfs.0 Request processed in 725us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823622.913372:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 164 00000100:00100000:0.0:1787823622.916616:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823622.916717:0:12014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629861504 00000100:00100000:1.0:1787823622.916729:0:12014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629861504 00000100:00100000:1.0:1787823622.916848:0:12014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 46 00000100:00100000:1.0:1787823622.916868:0:12014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ac86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:353832f0-fe7b-4d99-975c-a8041babed42+52:11472:x1874668629861504:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:1.0:1787823622.917151:0:12014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ac86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:353832f0-fe7b-4d99-975c-a8041babed42+53:11472:x1874668629861504:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 284us (544us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1787823622.917159:0:12014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 46 00000100:00100000:2.0:1787823622.958049:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823622.958144:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629861760 00000100:00100000:1.0:1787823622.958155:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629861760 00000100:00100000:1.0:1787823622.958215:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 165 00000100:00100000:1.0:1787823622.958227:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926246940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+53:11476:x1874668629861760:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:1.0:1787823622.958252:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823622.958271:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b83248224e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44956 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.958360:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482255 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.958376:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482255 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.958388:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482255 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.958404:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b83248225c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.958428:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b83248225c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.958435:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b83248225c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.958578:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832482263 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.958588:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832482263 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.958596:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832482263 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787823622.958606:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787823622.959108:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482255 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.959116:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482255 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.959124:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482255 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.959130:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eeaa00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823622.959134:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482255 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.959141:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482255 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.959166:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e7917859e00) 00010000:00010000:1.0:1787823622.959169:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823622.959173:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482255 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.959180:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482255 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.959195:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b83248225c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.959201:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b83248225c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.959206:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b83248225c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.959211:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eeac00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823622.959214:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b83248225c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.959220:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b83248225c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.959227:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e7917859300) 00010000:00010000:1.0:1787823622.959229:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823622.959232:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b83248225c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.959238:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b83248225c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.959303:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b83248224e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44956 expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.959318:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832482263 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44956 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.959325:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228dad00) 00010000:00010000:1.0:1787823622.959328:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787823622.959330:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7920eea600, rc 0) 00000100:00100000:1.0:1787823622.959404:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926246940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+55:11476:x1874668629861760:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 1179us (1365us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1787823622.959413:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 165 00000100:00100000:2.0:1787823622.963645:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823622.963697:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823622.964095:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629861888 00000100:00100000:1.0:1787823622.964106:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629861888 00000100:00100000:1.0:1787823622.964177:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 13 00000100:00100000:1.0:1787823622.964187:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926244f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:353832f0-fe7b-4d99-975c-a8041babed42+55:2355:x1874668629861888:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787823622.964205:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823622.964231:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832482263 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44956 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823622.964253:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228dad00) 00010000:00010000:1.0:1787823622.964259:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823622.964330:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926244f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:353832f0-fe7b-4d99-975c-a8041babed42+54:2355:x1874668629861888:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 145us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823622.964338:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 13 00000100:00100000:0.0:1787823622.965668:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629862016 00000100:00100000:0.0:1787823622.965682:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629862016 00000100:00100000:0.0:1787823622.965796:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 166 00000100:00100000:0.0:1787823622.965807:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926246580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+54:11476:x1874668629862016:12345-192.168.202.35@tcp:54:lfs.0 00010000:00010000:0.0:1787823622.965884:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482271 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823622.965902:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482271 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823622.965931:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482271 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823622.965961:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482271 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823622.965968:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482271 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823622.965975:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482271 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823622.965981:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40f600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823622.965985:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482271 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823622.965992:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482271 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823622.966003:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228dad00) 00010000:00010000:0.0:1787823622.966006:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787823622.966010:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482271 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823622.966016:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482271 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823622.966078:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926246580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+54:11476:x1874668629862016:12345-192.168.202.35@tcp:54:lfs.0 Request processed in 273us (2444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823622.966086:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 166 00000100:00100000:2.0:1787823622.969225:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823622.969351:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629862272 00000100:00100000:3.0:1787823622.969363:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629862272 00000100:00100000:3.0:1787823622.969420:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 47 00000100:00100000:3.0:1787823622.969431:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926245a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+54:11476:x1874668629862272:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:3.0:1787823622.969928:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926245a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+55:11476:x1874668629862272:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 494us (710us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1787823622.969937:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 47 00000100:00100000:2.0:1787823623.191234:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823623.191348:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629862528 00000100:00100000:1.0:1787823623.191360:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629862528 00000100:00100000:1.0:1787823623.191424:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 167 00000100:00100000:1.0:1787823623.191436:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926244b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+55:11494:x1874668629862528:12345-192.168.202.35@tcp:101:cat.0 00010000:00010000:1.0:1787823623.191461:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823623.191483:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832482278 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f4495d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823623.191637:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b83248227f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823623.191653:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b83248227f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823623.191667:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b83248227f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787823623.191678:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787823623.191901:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832482278 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4495d expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823623.191928:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b83248227f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4495d expref: 57 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823623.191938:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228dad00) 00010000:00010000:1.0:1787823623.191942:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787823623.191946:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7920eea400, rc 0) 00000100:00100000:1.0:1787823623.192033:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926244b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+57:11494:x1874668629862528:12345-192.168.202.35@tcp:101:cat.0 Request processed in 599us (809us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1787823623.192056:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 167 00000100:00100000:2.0:1787823623.265693:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823623.265808:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629862656 00000100:00100000:0.0:1787823623.265831:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629862656 00000100:00100000:0.0:1787823623.265909:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 168 00000100:00100000:0.0:1787823623.265927:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926245680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+57:11495:x1874668629862656:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787823623.265963:0:7893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823623.265985:0:7893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b83248228d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44964 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.266062:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482294 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.266078:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482294 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.266090:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482294 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787823623.266156:0:7893:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787823623.266160:0:7893:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787823623.266183:0:7893:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482294 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.266211:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b83248228d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44964 expref: 59 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.266231:0:7893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482294 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44964 expref: 58 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.266239:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e7917859e00) 00010000:00010000:0.0:1787823623.266242:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787823623.266245:0:7893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40ec00, rc 0) 00000100:00100000:0.0:1787823623.266325:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926245680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+58:11495:x1874668629862656:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 399us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823623.266332:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 168 00000100:00100000:2.0:1787823623.286387:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823623.290771:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629863040 00000100:00100000:0.0:1787823623.291673:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629863040 00000100:00100000:1.0:1787823623.291929:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 48 00000100:00100000:1.0:1787823623.292064:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+58:11495:x1874668629863040:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:1.0:1787823623.292447:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+59:11495:x1874668629863040:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 385us (6069us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1787823623.300525:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823623.300613:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629863168 00000100:00100000:3.0:1787823623.300624:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629863168 00000100:00100000:1.0:1787823623.301896:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 48 00000100:00100000:3.0:1787823623.303654:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 14 00000100:00100000:3.0:1787823623.303678:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790aef0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:353832f0-fe7b-4d99-975c-a8041babed42+59:11495:x1874668629863168:12345-192.168.202.35@tcp:103:lfs.0 00010000:00010000:3.0:1787823623.303699:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787823623.303730:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c400/0x5d1142b832482224 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44948 expref: 59 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.303755:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b83248227f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4495d expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.303821:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b83248212f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44909 expref: 57 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.303831:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228dad00) 00010000:00010000:3.0:1787823623.303841:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787823623.303919:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790aef0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:353832f0-fe7b-4d99-975c-a8041babed42+56:11495:x1874668629863168:12345-192.168.202.35@tcp:103:lfs.0 Request processed in 252us (3418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823623.303927:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 14 00000100:00100000:3.0:1787823623.309497:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823623.310058:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629863296 00000100:00100000:1.0:1787823623.310073:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629863296 00000100:00100000:1.0:1787823623.310142:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 169 00000100:00100000:1.0:1787823623.310154:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+56:11495:x1874668629863296:12345-192.168.202.35@tcp:58:lfs.0 00010000:00010000:1.0:1787823623.310274:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b83248229b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823623.310305:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b83248229b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823623.310317:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b83248229b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787823623.311232:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1787823623.311344:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+56:11495:x1874668629863296:12345-192.168.202.35@tcp:58:lfs.0 Request processed in 1189us (1854us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823623.311365:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 169 00000100:00100000:1.0:1787823623.353506:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823623.353688:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629863424 00000100:00100000:0.0:1787823623.353708:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629863424 00000100:00100000:0.0:1787823623.353808:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 170 00000100:00100000:0.0:1787823623.353821:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+56:11497:x1874668629863424:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787823623.353864:0:7893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823623.353888:0:7893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e200/0x5d1142b8324822a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f4496b expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.353976:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b8324822a9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.353993:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b8324822a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.354005:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b8324822a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.354022:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b8324822b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.354029:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b8324822b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.354034:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b8324822b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.354149:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b8324822b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.354157:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b8324822b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.354164:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b8324822b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787823623.354199:0:7893:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787823623.354203:0:7893:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787823623.354222:0:7893:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b8324822b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.354232:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b8324822b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.354239:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b8324822a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.354245:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b8324822a9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.354251:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b8324822a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.354256:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40fa00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823623.354260:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b8324822a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.354266:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b8324822a9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.354297:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e7917859e00) 00010000:00010000:0.0:1787823623.354300:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823623.354306:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b8324822a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.354312:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b8324822a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.354325:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b8324822b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.354331:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b8324822b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.354336:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b8324822b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.354340:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40f800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823623.354343:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b8324822b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.354348:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b8324822b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.355030:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e791767be00) 00010000:00010000:0.0:1787823623.355035:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823623.355039:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b8324822b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.355045:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b8324822b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.355107:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e200/0x5d1142b8324822a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4496b expref: 58 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.355126:0:7893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b8324822b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4496b expref: 57 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.355132:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e7917859300) 00010000:00010000:0.0:1787823623.355135:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787823623.355137:0:7893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40ea00, rc 0) 00000100:00100000:0.0:1787823623.355201:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+57:11497:x1874668629863424:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 1382us (1708us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823623.355209:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 170 00010000:00010000:1.0:1787823623.405490:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787823623.658167:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787823623.658175:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787823623.658230:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787823623.658237:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787823623.658375:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a2ecf00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1874668651883392:192.168.202.35@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787823623.658676:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908f8c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787823623.674955:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a2ecf00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1874668651883392:192.168.202.35@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787823623.679425:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823623.679476:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629863552 00000100:00100000:1.0:1787823623.679507:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629863552 00000100:00100000:1.0:1787823623.679576:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 171 00000100:00100000:1.0:1787823623.679587:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fd7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+57:11508:x1874668629863552:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787823623.679619:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787823623.679734:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fd7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+57:11508:x1874668629863552:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 Request processed in 149us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823623.679742:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 171 00000100:00100000:3.0:1787823623.692174:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823623.699671:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629863680 00000100:00100000:2.0:1787823623.699697:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629863680 00000100:00100000:3.0:1787823623.702451:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 172 00000100:00100000:3.0:1787823623.702466:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+57:11508:x1874668629863680:12345-192.168.202.35@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787823623.702567:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c400/0x5d1142b8324822be lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.702584:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c400/0x5d1142b8324822be lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.702597:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c400/0x5d1142b8324822be lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.702613:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b8324822c5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.702619:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b8324822c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.702625:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b8324822c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.702650:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d800/0x5d1142b8324822cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.702658:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d800/0x5d1142b8324822cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.702664:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d800/0x5d1142b8324822cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787823623.702716:0:7893:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787823623.702733:0:7893:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787823623.702745:0:7893:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d800/0x5d1142b8324822cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.702775:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c400/0x5d1142b8324822be lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.702783:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c400/0x5d1142b8324822be lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.702789:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c400/0x5d1142b8324822be lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.702796:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26c400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823623.702800:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c400/0x5d1142b8324822be lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.702807:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c400/0x5d1142b8324822be lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.702819:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e7917859800) 00010000:00010000:3.0:1787823623.702823:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787823623.702827:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c400/0x5d1142b8324822be lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.702834:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c400/0x5d1142b8324822be lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.702848:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b8324822c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.702853:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b8324822c5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.702868:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b8324822c5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.702874:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26dc00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823623.702876:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b8324822c5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.702883:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b8324822c5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.702890:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8e79087c9700) 00010000:00010000:3.0:1787823623.702893:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787823623.702896:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b8324822c5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.702901:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b8324822c5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.702918:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d800/0x5d1142b8324822cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.702924:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d800/0x5d1142b8324822cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.702929:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d800/0x5d1142b8324822cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.702934:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26d800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823623.702936:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d800/0x5d1142b8324822cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.702956:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d800/0x5d1142b8324822cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.702966:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e7917859300) 00010000:00010000:3.0:1787823623.702968:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787823623.702971:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d800/0x5d1142b8324822cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.702976:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d800/0x5d1142b8324822cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823623.703059:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+57:11508:x1874668629863680:12345-192.168.202.35@tcp:34:lhsmtool_posix.0 Request processed in 596us (10895us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823623.703068:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 172 00000100:00100000:3.0:1787823623.707482:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823623.707650:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629863936 00000100:00100000:2.0:1787823623.707660:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629863936 00000100:00100000:2.0:1787823623.707738:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 173 00000100:00100000:2.0:1787823623.707749:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+57:11508:x1874668629863936:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787823623.707791:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823623.707812:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b8324822d3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44972 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.707969:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b8324822da lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.707986:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b8324822da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.707999:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b8324822da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787823623.708011:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787823623.708108:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b8324822da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.708116:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b8324822da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.708139:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b8324822da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.708144:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26c800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823623.708148:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b8324822da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.708155:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b8324822da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.708167:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e7917859300) 00010000:00010000:3.0:1787823623.708170:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787823623.708175:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b8324822da lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.708181:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b8324822da lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.708219:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b8324822d3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44972 expref: 59 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.708228:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e7917859800) 00010000:00010000:3.0:1787823623.708230:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787823623.708234:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b8324822d3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44972 expref: 59 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.708242:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d3800, rc 0) 00000100:00100000:3.0:1787823623.708318:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+58:11508:x1874668629863936:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 571us (845us total) trans 4294967458 rc 301/301 00000100:00100000:3.0:1787823623.708336:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 173 00000100:00100000:1.0:1787823623.715505:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823623.716345:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629864064 00000100:00100000:3.0:1787823623.716463:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629864064 00000100:00100000:3.0:1787823623.716541:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 174 00000100:00100000:3.0:1787823623.716565:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+58:11508:x1874668629864064:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787823623.716603:0:7893:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787823623.716746:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+58:11508:x1874668629864064:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 Request processed in 195us (1249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823623.716754:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 174 00000100:00100000:2.0:1787823623.727718:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823623.727808:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629864320 00000100:00100000:0.0:1787823623.727818:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629864320 00000100:00100000:0.0:1787823623.727886:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 175 00000100:00100000:0.0:1787823623.727897:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+58:11508:x1874668629864320:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787823623.727916:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823623.727920:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787823623.727946:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482294 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44964 expref: 58 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.727965:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e7917859e00) 00010000:00010000:0.0:1787823623.727971:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787823623.727985:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b8324822e8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44979 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787823623.728448:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1787823623.728658:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b8324822ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.728672:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b8324822ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.728682:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b8324822ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.728736:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b8324822e8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44979 expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.728751:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b8324822ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44979 expref: 59 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.728791:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e791767be00) 00010000:00010000:0.0:1787823623.728794:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787823623.728796:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40fa00, rc 0) 00000100:00100000:0.0:1787823623.728865:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+59:11508:x1874668629864320:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 970us (1154us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1787823623.728876:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 175 00000100:00100000:2.0:1787823623.735149:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823623.735796:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629864576 00000100:00100000:3.0:1787823623.735810:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629864576 00000100:00100000:3.0:1787823623.735878:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 176 00000100:00100000:3.0:1787823623.735889:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+59:11508:x1874668629864576:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787823623.735947:0:7893:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787823623.735972:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b8324822ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44979 expref: 59 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.735992:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e791767be00) 00010000:00010000:3.0:1787823623.736003:0:7893:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787823623.736026:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b8324822fd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.736039:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b8324822fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.736047:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b8324822fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.736115:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d800/0x5d1142b832482304 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xae52efdf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.736123:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d800/0x5d1142b832482304 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xae52efdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.736130:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d800/0x5d1142b832482304 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xae52efdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.736219:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b8324822fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.736227:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b8324822fd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.736235:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b8324822fd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.736240:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26c800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823623.736245:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b8324822fd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.736253:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b8324822fd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.736261:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e7917859e00) 00010000:00010000:3.0:1787823623.736264:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787823623.736268:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b8324822fd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.736275:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b8324822fd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.737469:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d800/0x5d1142b832482304 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xae52efdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.737476:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d800/0x5d1142b832482304 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xae52efdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.737483:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d800/0x5d1142b832482304 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xae52efdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.737488:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26d800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823623.737492:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d800/0x5d1142b832482304 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xae52efdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.737498:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d800/0x5d1142b832482304 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xae52efdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.737511:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xae52efdf (ffff8e79087c9700) 00010000:00010000:3.0:1787823623.737514:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787823623.737518:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d800/0x5d1142b832482304 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xae52efdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.737524:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d800/0x5d1142b832482304 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xae52efdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823623.737919:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+58:11508:x1874668629864576:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 Request processed in 2025us (2772us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787823623.737929:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 176 00000100:00100000:3.0:1787823623.740883:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823623.740985:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629864704 00000100:00100000:2.0:1787823623.741004:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629864704 00000100:00100000:2.0:1787823623.741062:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 177 00000100:00100000:2.0:1787823623.741085:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+58:11508:x1874668629864704:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787823623.741104:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823623.741127:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b83248230b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44980 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823623.741159:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482312 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823623.741173:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482312 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823623.741184:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482312 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823623.741305:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b83248230b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44980 expref: 60 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823623.741325:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482312 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44980 expref: 59 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823623.741334:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e79228da400) 00010000:00010000:2.0:1787823623.741336:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787823623.741340:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d3a00, rc 0) 00000100:00100000:2.0:1787823623.741410:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+59:11508:x1874668629864704:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 327us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823623.741417:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 177 00000100:00100000:3.0:1787823623.765321:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823623.765410:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629864960 00000100:00100000:0.0:1787823623.765421:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629864960 00000100:00100000:0.0:1787823623.765498:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 178 00000100:00100000:0.0:1787823623.765510:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+59:11508:x1874668629864960:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787823623.765602:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832482319 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.765629:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832482319 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823623.765640:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832482319 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787823623.766213:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1787823623.766224:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 364620464762ns, next at 365620462006ns, rc = 0 00000004:00010000:0.0:1787823623.766322:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000de1a1022 reply state 0000000092c1662e transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832482319 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823623.766332:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787823623.766441:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+61:11508:x1874668629864960:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 Request processed in 931us (1130us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1787823623.766449:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 178 00010000:00010000:1.0:1787823623.775742:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832482319 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823623.775775:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832482319 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823623.775784:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832482319 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823623.775790:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40f800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823623.775794:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832482319 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823623.775803:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832482319 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823623.775824:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e79228da400) 00010000:00010000:1.0:1787823623.775827:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787823623.775832:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832482319 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823623.775838:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832482319 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823623.778732:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823623.780529:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629865088 00000100:00100000:3.0:1787823623.780547:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629865088 00000100:00100000:3.0:1787823623.780655:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 179 00000100:00100000:3.0:1787823623.780667:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fd5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+60:11508:x1874668629865088:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787823623.780713:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823623.780734:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d800/0x5d1142b832482320 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44987 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.780817:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d800/0x5d1142b832482320 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44987 expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.780832:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d800/0x5d1142b832482320 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44987 expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.780865:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e79228da400) 00010000:00010000:3.0:1787823623.780868:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787823623.780872:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a26d800, rc 0) 00000100:00100000:3.0:1787823623.780939:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fd5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+61:11508:x1874668629865088:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 275us (2219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823623.780946:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 179 00000100:00100000:0.0:1787823623.793073:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823623.793204:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629865216 00000100:00100000:1.0:1787823623.793213:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629865216 00000100:00100000:1.0:1787823623.793294:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 50 00000100:00100000:1.0:1787823623.793304:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790aef0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+6:2353:x1874668629865216:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787823623.793903:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790aef0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+7:2353:x1874668629865216:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 Request processed in 597us (837us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1787823623.793913:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 50 00000100:00080000:0.0:1787823623.794229:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787823623.809248:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823623.809431:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629865472 00000100:00100000:3.0:1787823623.809442:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629865472 00000100:00100000:3.0:1787823623.809504:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 49 00000100:00100000:3.0:1787823623.809515:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fd70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+61:11508:x1874668629865472:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787823623.810149:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fd70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+62:11508:x1874668629865472:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 Request processed in 632us (909us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1787823623.810159:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 49 00000100:00100000:3.0:1787823623.814364:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823623.814439:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629865728 00000100:00100000:0.0:1787823623.814449:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629865728 00000100:00100000:0.0:1787823623.814518:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 180 00000100:00100000:0.0:1787823623.814528:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+62:11508:x1874668629865728:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787823623.814654:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+62:11508:x1874668629865728:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 Request processed in 127us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823623.814661:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 180 00000100:00100000:0.0:1787823623.817001:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823623.817226:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629865856 00000100:00100000:1.0:1787823623.817236:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629865856 00000100:00100000:1.0:1787823623.817303:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 181 00000100:00100000:1.0:1787823623.817312:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939dc3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+62:11508:x1874668629865856:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787823623.817332:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823623.817353:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832482327 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f4498e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823623.817417:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b83248232e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823623.817431:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b83248232e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823623.817441:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b83248232e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787823623.817473:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787823623.817509:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b83248232e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823623.817534:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832482327 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4498e expref: 64 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823623.817562:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b83248232e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4498e expref: 63 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823623.817572:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e79228da400) 00010000:00010000:1.0:1787823623.817574:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787823623.817578:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7920eea400, rc 0) 00000100:00100000:1.0:1787823623.818223:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939dc3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+63:11508:x1874668629865856:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 906us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823623.818233:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 181 00000100:00100000:0.0:1787823623.847326:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823623.847465:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629865984 00000100:00100000:2.0:1787823623.847486:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629865984 00000100:00100000:2.0:1787823623.847548:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 51 00000100:00100000:2.0:1787823623.847577:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939dc2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+7:2352:x1874668629865984:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787823623.847598:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823623.847620:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028c6d5f8/0x5d1142b832482335 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44995 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787823623.847649:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a900608, blocks: 0x1 00010000:00010000:2.0:1787823623.847668:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=364s v=(0 0) 00010000:00010000:2.0:1787823623.847673:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823623.847682:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028c6d5f8/0x5d1142b832482335 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44995 expref: 8 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823623.847917:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000028c6d5f8/0x5d1142b832482335 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44995 expref: 8 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823623.847934:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d2a00, rc 0) 00000100:00100000:2.0:1787823623.848065:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939dc2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+8:2352:x1874668629865984:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 491us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823623.848074:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 51 00000100:00100000:2.0:1787823623.854719:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823623.854937:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629866240 00000100:00100000:0.0:1787823623.854957:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629866240 00000100:00100000:0.0:1787823623.855019:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 182 00000100:00100000:0.0:1787823623.855031:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+63:11508:x1874668629866240:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787823623.855148:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+63:11508:x1874668629866240:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 Request processed in 119us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823623.855156:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 182 00000100:00100000:1.0:1787823623.870753:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823623.870976:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629866368 00000100:00100000:3.0:1787823623.870987:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629866368 00000100:00100000:3.0:1787823623.871057:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 52 00000100:00100000:3.0:1787823623.871068:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fd4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+8:11508:x1874668629866368:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787823623.871092:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823623.871118:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060f2b147/0x5d1142b83248233c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f4499c expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.871158:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000028c6d5f8/0x5d1142b832482335 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44995 expref: 9 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.871170:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787823623.871175:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787823623.871182:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060f2b147/0x5d1142b83248233c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4499c expref: 9 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.871220:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000028c6d5f8/0x5d1142b832482335 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44995 expref: 9 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.871236:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000028c6d5f8/0x5d1142b832482335 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44995 expref: 9 pid: 6686 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823623.871253:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a2ee1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6687:1874668651883520:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787823623.871389:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908f8cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787823623.882708:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823623.883027:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a2ee1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6687:1874668651883520:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787823623.883075:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000060f2b147/0x5d1142b83248233c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4499c expref: 9 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823623.883131:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a26c800, rc 0) 00000100:00100000:3.0:1787823623.883216:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fd4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+9:11508:x1874668629866368:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 12149us (12478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823623.883226:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 52 00000100:00100000:1.0:1787823623.883297:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629866496 00000100:00100000:1.0:1787823623.883306:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629866496 00010000:00010000:1.0:1787823623.883348:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000028c6d5f8/0x5d1142b832482335 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44995 expref: 9 pid: 6686 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823623.883390:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 67 00000100:00100000:1.0:1787823623.883400:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0eda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:353832f0-fe7b-4d99-975c-a8041babed42+9:2352:x1874668629866496:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787823623.883420:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823623.883450:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000028c6d5f8/0x5d1142b832482335 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44995 expref: 9 pid: 6686 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823623.883462:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000028c6d5f8/0x5d1142b832482335 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44995 expref: 9 pid: 6686 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823623.885658:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028c6d5f8/0x5d1142b832482335 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44995 expref: 9 pid: 6686 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823623.885683:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787823623.885687:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787823623.885695:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000060f2b147/0x5d1142b83248233c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4499c expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823623.885705:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060f2b147/0x5d1142b83248233c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4499c expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823623.885755:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000060f2b147/0x5d1142b83248233c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4499c expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823623.885789:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7906fd6940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5824:1874668651883648:192.168.202.35@tcp:105: 00000100:00100000:1.0:1787823623.885877:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e790bdbec00 going to sleep for 11 seconds 00000100:00100000:1.0:1787823623.890142:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7906fd6940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5824:1874668651883648:192.168.202.35@tcp:105: 00010000:00010000:1.0:1787823623.890183:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823623.890244:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0eda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:353832f0-fe7b-4d99-975c-a8041babed42+8:2352:x1874668629866496:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 6844us (7568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823623.890255:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 67 00000100:00100000:2.0:1787823623.895923:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823623.896075:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629866624 00000100:00100000:3.0:1787823623.896085:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629866624 00002000:00100000:3.0:1787823623.896137:0:6693:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8e793a0ede00 x1874668629866624/t0(0) o4->353832f0-fe7b-4d99-975c-a8041babed42@192.168.202.35@tcp:244/0 lens 504/0 e 0 to 0 dl 1787823634 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787823623.896149:0:6693:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8e793a0ede00 with x1874668629866624 ext(0->8) 00002000:00010000:3.0:1787823623.896156:0:6693:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e793a0ede00 00000100:00100000:3.0:1787823623.896192:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 4 00000100:00100000:3.0:1787823623.896202:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0ede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:353832f0-fe7b-4d99-975c-a8041babed42+8:2353:x1874668629866624:12345-192.168.202.35@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787823623.897269:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0ede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:353832f0-fe7b-4d99-975c-a8041babed42+10:2353:x1874668629866624:12345-192.168.202.35@tcp:4:lhsmtool_posix.0 Request processed in 1062us (1351us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1787823623.897335:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 4 00002000:00100000:3.0:1787823623.897346:0:6693:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8e793a0ede00 x1874668629866624/t4294967314(0) o4->353832f0-fe7b-4d99-975c-a8041babed42@192.168.202.35@tcp:244/0 lens 504/448 e 0 to 0 dl 1787823634 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787823623.897356:0:6693:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8e793a0ede00 with x1874668629866624 ext(0->8) 00002000:00010000:3.0:1787823623.897361:0:6693:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e793a0ede00 00000100:00100000:2.0:1787823623.905405:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823623.905570:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629866752 00000100:00100000:3.0:1787823623.905584:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629866752 00000100:00100000:3.0:1787823623.905656:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 183 00000100:00100000:3.0:1787823623.905668:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+63:11508:x1874668629866752:12345-192.168.202.35@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787823624.016542:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+63:11508:x1874668629866752:12345-192.168.202.35@tcp:44:lhsmtool_posix.0 Request processed in 110864us (111135us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823624.016569:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 183 00000001:00080000:1.0:1787823624.016618:0:12271:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:1.0:1787823624.016624:0:12271:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:1.0:1787823624.016684:0:12271:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000001:00080000:1.0:1787823624.016713:0:12271:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000020:00080000:1.0:1787823624.016734:0:12271:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e7908f8cd80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1787823624.016739:0:12271:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e7918203b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e7908f8c3c0 00000020:00080000:1.0:1787823624.016742:0:12271:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e7903db7600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e7939d89c00 00000020:00080000:1.0:1787823624.017128:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1787823624.017311:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1787823624.017333:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7906fd6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651883776:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787823624.017397:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823624.017458:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787823624.017465:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793f99b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651883904:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787823624.017489:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823624.017527:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651883776 00000100:00100000:1.0:1787823624.017536:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651883776 00000100:00100000:1.0:1787823624.017622:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651883904 00000100:00100000:1.0:1787823624.017625:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651883904 00000100:00100000:1.0:1787823624.017643:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787823624.017653:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f99bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651883776:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787823624.017837:0:6686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787823624.017841:0:6686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787823624 00002000:00010000:1.0:1787823624.017844:0:6686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787823624.017846:0:6686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787823624 -> 1787823624 00002000:00010000:1.0:1787823624.017848:0:6686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787823624.017890:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f99bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1874668651883776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 238us (493us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787823624.017912:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787823624.017928:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787823624.017935:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1874668651883904:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787823624.017949:0:6686:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:1.0:1787823624.017972:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a900605, atime: 0x6a900605, ctime: 0x6a900605, blocks: 0x1 00010000:00010000:1.0:1787823624.017980:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008885472c/0x5d1142b832482343 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.017997:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=364s v=(0 0) 00010000:00010000:1.0:1787823624.018002:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787823624.018009:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008885472c/0x5d1142b832482343 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.018025:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008885472c/0x5d1142b832482343 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.018035:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008885472c/0x5d1142b832482343 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.018042:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008885472c/0x5d1142b832482343 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.018059:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787823624.018509:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1874668651883904:12345-0@lo:6:osp-syn-0-0.0 Request processed in 572us (1016us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787823624.018516:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1787823624.018564:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787823624.018569:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787823624.018581:0:7629:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787823624.018587:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008885472c/0x5d1142b832482343 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.018597:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eeaa00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:1.0:1787823624.018601:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008885472c/0x5d1142b832482343 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.018611:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008885472c/0x5d1142b832482343 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.018627:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008885472c/0x5d1142b832482343 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.018636:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008885472c/0x5d1142b832482343 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.018656:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823624.018658:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823624.018660:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787823624.018691:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e793f99b480/2, rc 0, transno 4294967307 00000100:00100000:1.0:1787823624.018697:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793f99b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651883904:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1787823624.018707:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e7906fd6940/2, rc 0, transno 4294967315 00000100:00100000:1.0:1787823624.018712:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7906fd6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651883776:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787823624.023061:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823624.024392:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629866880 00000100:00100000:2.0:1787823624.024406:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629866880 00000100:00100000:3.0:1787823624.024541:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 55 00000100:00100000:3.0:1787823624.024565:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f99a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+10:2355:x1874668629866880:12345-192.168.202.35@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787823624.081031:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:0.0:1787823624.081053:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:0.0:1787823624.085451:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:0.0:1787823624.092583:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f99a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+7:2355:x1874668629866880:12345-192.168.202.35@tcp:16:lhsmtool_posix.0 Request processed in 68013us (69514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823624.092600:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 55 00000100:00100000:1.0:1787823624.101253:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823624.101477:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629867136 00000100:00100000:2.0:1787823624.101488:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629867136 00000100:00100000:2.0:1787823624.101567:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 184 00000100:00100000:2.0:1787823624.101588:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f99b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+18:11508:x1874668629867136:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787823624.101639:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787823624.101663:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b83248232e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4498e expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.101681:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e79228da400) 00010000:00010000:2.0:1787823624.101685:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787823624.101723:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b83248234a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.101738:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b83248234a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.101749:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b83248234a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787823624.102146:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d10e441f reply state 000000006b56110f transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b83248234a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823624.102156:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787823624.102251:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f99b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+19:11508:x1874668629867136:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 Request processed in 664us (1007us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1787823624.102258:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 184 00000100:00080000:1.0:1787823624.104377:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787823624.111728:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00010000:00010000:2.0:1787823624.112034:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b83248234a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.112048:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b83248234a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.112057:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b83248234a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.112075:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823624.112081:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b83248234a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.112090:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b83248234a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.112110:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e79228da400) 00010000:00010000:2.0:1787823624.112114:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823624.112119:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b83248234a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.112126:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b83248234a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823624.113484:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629867264 00000100:00100000:2.0:1787823624.113497:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629867264 00000100:00100000:2.0:1787823624.113571:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 56 00000100:00100000:2.0:1787823624.113582:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+7:2353:x1874668629867264:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787823624.113862:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787823624.113866:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787823624 -> 1787823623 00002000:00010000:2.0:1787823624.113869:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787823621 00002000:00010000:2.0:1787823624.113871:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787823624 -> 1787823623 00002000:00010000:2.0:1787823624.113874:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787823624.114021:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+8:2353:x1874668629867264:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 Request processed in 439us (2304us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787823624.114030:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 56 00000100:00100000:2.0:1787823624.127579:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823624.127789:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629867520 00000100:00100000:1.0:1787823624.127800:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629867520 00000100:00100000:1.0:1787823624.128993:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 185 00000100:00100000:1.0:1787823624.129009:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e8092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+18:11508:x1874668629867520:12345-192.168.202.35@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787823624.129084:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482351 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.129100:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482312 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44980 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.129110:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482351 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.129142:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482312 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44980 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.129155:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482312 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44980 expref: 18 pid: 5839 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823624.129169:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec66940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1874668651884032:192.168.202.35@tcp:104: 00000100:00100000:1.0:1787823624.129256:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7904a38cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787823624.145183:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823624.145263:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629867648 00000100:00100000:0.0:1787823624.145283:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629867648 00010000:00010000:0.0:1787823624.145326:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482312 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44980 expref: 19 pid: 5839 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823624.145375:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 68 00000100:00100000:0.0:1787823624.145385:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79037f2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:353832f0-fe7b-4d99-975c-a8041babed42+19:2353:x1874668629867648:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787823624.145402:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787823624.145409:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482312 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44980 expref: 19 pid: 5839 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.145423:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482312 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44980 expref: 19 pid: 5839 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.145451:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e79228da400) 00010000:00010000:0.0:1787823624.145469:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482351 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.145480:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482351 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.145488:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482351 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.145509:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787823624.145574:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79037f2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:353832f0-fe7b-4d99-975c-a8041babed42+19:2353:x1874668629867648:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 190us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823624.145581:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 68 00010000:00010000:3.0:1787823624.146158:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482312 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44980 expref: 18 pid: 5839 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823624.146179:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec66940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1874668651884032:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787823624.146207:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482351 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.146216:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482351 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.146222:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482351 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.146254:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482351 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.146262:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482351 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.146268:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482351 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.146274:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eeaa00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823624.146278:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482351 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.146300:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482351 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.146311:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e79228da400) 00010000:00010000:3.0:1787823624.146313:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787823624.146317:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482351 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.146323:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482351 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823624.146391:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e8092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+17:11508:x1874668629867520:12345-192.168.202.35@tcp:55:lhsmtool_posix.0 Request processed in 17388us (18820us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787823624.146399:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 185 00000100:00100000:1.0:1787823624.163105:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823624.163145:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629867776 00000100:00100000:1.0:1787823624.163154:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629867776 00000100:00100000:1.0:1787823624.163207:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 57 00000100:00100000:1.0:1787823624.163217:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+8:2354:x1874668629867776:12345-192.168.202.35@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787823624.163447:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000076ad0d6e/0x5d1142b832482358 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.163468:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000060f2b147/0x5d1142b83248233c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4499c expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.163477:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787823624.163482:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787823624.163488:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076ad0d6e/0x5d1142b832482358 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.163522:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000060f2b147/0x5d1142b83248233c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4499c expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.163538:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000060f2b147/0x5d1142b83248233c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4499c expref: 8 pid: 6687 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823624.163565:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec643c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6686:1874668651884160:192.168.202.35@tcp:104: 00000100:00100000:1.0:1787823624.163650:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7904a38e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787823624.183129:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823624.183157:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629867904 00000100:00100000:3.0:1787823624.183166:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629867904 00010000:00010000:3.0:1787823624.183208:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000060f2b147/0x5d1142b83248233c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4499c expref: 9 pid: 6687 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823624.183245:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 69 00000100:00100000:3.0:1787823624.183255:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2eda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:353832f0-fe7b-4d99-975c-a8041babed42+9:2353:x1874668629867904:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787823624.183836:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787823624.183867:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000060f2b147/0x5d1142b83248233c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4499c expref: 9 pid: 6687 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.183884:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000060f2b147/0x5d1142b83248233c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4499c expref: 9 pid: 6687 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.183926:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787823624.183944:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787823624.183951:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000076ad0d6e/0x5d1142b832482358 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.183962:0:8457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076ad0d6e/0x5d1142b832482358 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.183983:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787823624.184040:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2eda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:353832f0-fe7b-4d99-975c-a8041babed42+9:2353:x1874668629867904:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 786us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823624.184048:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 69 00010000:00010000:1.0:1787823624.185172:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060f2b147/0x5d1142b83248233c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4499c expref: 8 pid: 6687 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823624.185192:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec643c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6686:1874668651884160:192.168.202.35@tcp:104: 00010000:00010000:1.0:1787823624.185217:0:6686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000076ad0d6e/0x5d1142b832482358 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.185241:0:6686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000076ad0d6e/0x5d1142b832482358 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.185249:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076ad0d6e/0x5d1142b832482358 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.185815:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000076ad0d6e/0x5d1142b832482358 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.185828:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076ad0d6e/0x5d1142b832482358 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.185837:0:6686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076ad0d6e/0x5d1142b832482358 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.185845:0:6686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eea400 already unused, calling callback (ffffffffc1649440) 00010000:00010000:1.0:1787823624.185850:0:6686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076ad0d6e/0x5d1142b832482358 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.185860:0:6686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076ad0d6e/0x5d1142b832482358 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.185879:0:6686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076ad0d6e/0x5d1142b832482358 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.185899:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076ad0d6e/0x5d1142b832482358 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823624.185993:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+7:2354:x1874668629867776:12345-192.168.202.35@tcp:1:lhsmtool_posix.0 Request processed in 22775us (22898us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823624.186003:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 57 00000100:00100000:0.0:1787823624.197155:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823624.197285:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629868160 00000100:00100000:3.0:1787823624.197294:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629868160 00000100:00100000:3.0:1787823624.197436:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 186 00000100:00100000:3.0:1787823624.197447:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939dc0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+17:11508:x1874668629868160:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787823624.197531:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b83248235f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.197559:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b83248235f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.197574:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b83248235f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.197852:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c400/0x5d1142b832482366 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.197878:0:7893:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d800/0x5d1142b832482320 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44987 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.197887:0:7893:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c400/0x5d1142b832482366 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.197933:0:7893:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d800/0x5d1142b832482320 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44987 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.197949:0:7893:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d800/0x5d1142b832482320 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44987 expref: 18 pid: 5838 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823624.197964:0:7893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a2ee940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7893:1874668651884288:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787823624.198048:0:7893:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7909b75c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787823624.206861:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823624.206919:0:7893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a2ee940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7893:1874668651884288:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787823624.206959:0:7893:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c400/0x5d1142b832482366 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823624.207225:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629868288 00000100:00100000:1.0:1787823624.207233:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629868288 00010000:00010000:1.0:1787823624.207288:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d800/0x5d1142b832482320 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44987 expref: 19 pid: 5838 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823624.207330:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 70 00000100:00100000:1.0:1787823624.207342:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939df8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:353832f0-fe7b-4d99-975c-a8041babed42+19:2352:x1874668629868288:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787823624.207590:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823624.207599:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d800/0x5d1142b832482320 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44987 expref: 19 pid: 5838 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.207612:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d800/0x5d1142b832482320 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44987 expref: 19 pid: 5838 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.207635:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d800/0x5d1142b832482320 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44987 expref: 19 pid: 5838 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.207653:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e79228da400) 00010000:00010000:1.0:1787823624.207657:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c400/0x5d1142b832482366 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.207679:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c400/0x5d1142b832482366 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.207687:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c400/0x5d1142b832482366 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.207723:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823624.207800:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939df8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:353832f0-fe7b-4d99-975c-a8041babed42+18:2352:x1874668629868288:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 459us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823624.207807:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 70 00010000:00010000:0.0:1787823624.208022:0:7893:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c400/0x5d1142b832482366 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.208030:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c400/0x5d1142b832482366 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787823624.208214:0:7893:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1787823624.208387:0:7893:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:0.0:1787823624.208437:0:7893:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1787823624.208521:0:7893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7939df8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7893:1874668651884416:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787823624.208587:0:7893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823624.208627:0:7893:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e791a680480 going to sleep for 11 seconds 00000100:00100000:0.0:1787823624.208648:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651884416 00000100:00100000:0.0:1787823624.208654:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651884416 00000100:00100000:0.0:1787823624.208693:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787823624.208702:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7893:x1874668651884416:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787823624.208792:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7893:x1874668651884416:12345-0@lo:1000:mdt00_003.0 Request processed in 91us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823624.208800:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787823624.208837:0:7893:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1787823624.208842:0:7893:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e7906fd6940, transno 4294967315 00000100:00100000:0.0:1787823624.208854:0:7893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7939df8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7893:1874668651884416:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1787823624.209280:0:7893:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:0.0:1787823624.209337:0:7893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7939df8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7893:1874668651884544:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787823624.209367:0:7893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823624.209384:0:7893:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7904995540 going to sleep for 11 seconds 00000100:00100000:0.0:1787823624.209398:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651884544 00000100:00100000:0.0:1787823624.209402:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651884544 00000100:00100000:0.0:1787823624.209426:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787823624.209434:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926244f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7893:x1874668651884544:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787823624.209600:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926244f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7893:x1874668651884544:12345-0@lo:1000:mdt00_003.0 Request processed in 165us (231us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1787823624.209606:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787823624.209640:0:7893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7939df8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7893:1874668651884544:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1787823624.209668:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c400/0x5d1142b832482366 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.209677:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c400/0x5d1142b832482366 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.209693:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c400/0x5d1142b832482366 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.209699:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26c400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823624.209704:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c400/0x5d1142b832482366 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.209712:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c400/0x5d1142b832482366 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.209727:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e79228da400) 00010000:00010000:0.0:1787823624.209730:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787823624.209735:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c400/0x5d1142b832482366 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.209742:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c400/0x5d1142b832482366 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.209795:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b83248229b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.209802:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b83248229b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.209807:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b83248229b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.209813:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eeac00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823624.209815:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b83248229b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.209831:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b83248229b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.209841:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e7917859300) 00010000:00010000:0.0:1787823624.209843:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787823624.209846:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b83248229b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.209851:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b83248229b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.209875:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b83248236d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.209888:0:7893:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b8324822b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4496b expref: 21 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.209896:0:7893:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b83248236d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.209921:0:7893:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b8324822b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4496b expref: 21 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.209935:0:7893:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b8324822b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4496b expref: 21 pid: 7893 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823624.209946:0:7893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7893:1874668651884672:192.168.202.35@tcp:104: 00000100:00100000:0.0:1787823624.210008:0:7893:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e790ad6acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787823624.222856:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823624.222935:0:7893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7893:1874668651884672:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787823624.222978:0:7893:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b83248236d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823624.223017:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629868416 00000100:00100000:3.0:1787823624.223027:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629868416 00010000:00010000:3.0:1787823624.223082:0:7631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b8324822b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4496b expref: 22 pid: 7893 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823624.223139:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 71 00000100:00100000:3.0:1787823624.223153:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:353832f0-fe7b-4d99-975c-a8041babed42+22:2353:x1874668629868416:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787823624.223189:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787823624.223197:0:7631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b8324822b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4496b expref: 22 pid: 7893 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.223211:0:7631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b8324822b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4496b expref: 22 pid: 7893 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.223240:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b8324822b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4496b expref: 22 pid: 7893 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.223259:0:7631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e7917859300) 00010000:00010000:3.0:1787823624.223264:0:7631:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b83248236d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.223275:0:7631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b83248236d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.223297:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b83248236d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.223325:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787823624.223389:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:353832f0-fe7b-4d99-975c-a8041babed42+21:2353:x1874668629868416:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 238us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823624.223398:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 71 00010000:00010000:3.0:1787823624.223426:0:7893:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b83248236d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.223433:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b83248236d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.223454:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b83248236d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.223460:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b83248236d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.223468:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b83248236d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.223474:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40e000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823624.223479:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b83248236d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.223487:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b83248236d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.223496:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e7917859300) 00010000:00010000:3.0:1787823624.223499:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787823624.223503:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b83248236d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.223510:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b83248236d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.223521:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b83248235f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.223526:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b83248235f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.223532:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b83248235f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.223541:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26dc00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823624.223544:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b83248235f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.223564:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b83248235f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.223573:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e7917859300) 00010000:00010000:3.0:1787823624.223575:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787823624.223578:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b83248235f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.223584:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b83248235f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823624.223859:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939dc0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+20:11508:x1874668629868160:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 Request processed in 26413us (26713us total) trans 4294967467 rc 0/0 00000100:00100000:3.0:1787823624.223869:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 186 00000020:00080000:3.0:1787823624.223873:0:7893:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787823624.224113:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787823624.224118:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787823624.224618:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1787823624.224632:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787823624.230021:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823624.238240:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629868672 00000100:00100000:2.0:1787823624.238266:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629868672 00000100:00100000:2.0:1787823624.240543:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 50 00000100:00100000:2.0:1787823624.240573:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7925a91050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+20:11508:x1874668629868672:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787823624.241448:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787823624.241597:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:2.0:1787823624.241660:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482374 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.241684:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482374 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.241697:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482374 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.241708:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482374 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.241716:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482374 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.241722:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482374 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.241751:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787823624.241902:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7925a91050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+22:11508:x1874668629868672:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 Request processed in 1331us (11889us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1787823624.241912:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 50 00000020:00080000:2.0:1787823624.241918:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787823624.242008:0:7630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787823624.242016:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482374 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.242030:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3400 already unused, calling callback (ffffffffc1649440) 00010000:00010000:2.0:1787823624.242034:0:7630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482374 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.242041:0:7630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482374 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.242056:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e79228da800) 00010000:00010000:2.0:1787823624.242059:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787823624.242064:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482374 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.242071:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482374 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.242089:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823624.242091:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823624.242092:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787823624.288704:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:1.0:1787823624.288725:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00010000:00010000:0.0:1787823624.425893:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787823624.552747:0:12461:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787823624.552786:0:12461:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787823624.555536:0:12461:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787823624.555558:0:12461:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787823624.683445:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792e80a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651884800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787823624.683522:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823624.683651:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651884800 00000100:00100000:2.0:1787823624.683658:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651884800 00000100:00100000:2.0:1787823624.683736:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787823624.683746:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e808b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651884800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787823624.683823:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787823624.683897:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e808b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651884800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823624.683906:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787823624.685890:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:2.0:1787823624.685897:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:2.0:1787823624.686036:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e793f99b480, transno 4294967307 00000100:00100000:2.0:1787823624.686085:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792e80a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651884800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787823624.747497:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823624.747579:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629868928 00000100:00100000:3.0:1787823624.747589:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629868928 00000100:00100000:3.0:1787823624.747684:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 187 00000100:00100000:3.0:1787823624.747694:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790aef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+22:11519:x1874668629868928:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:3.0:1787823624.747721:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823624.747744:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b83248237b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f449a3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.748187:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c600/0x5d1142b832482382 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.748217:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c600/0x5d1142b832482382 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.748231:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c600/0x5d1142b832482382 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787823624.748245:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1787823624.748418:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b83248237b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449a3 expref: 25 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.748436:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c600/0x5d1142b832482382 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449a3 expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.748445:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e7917859e00) 00010000:00010000:3.0:1787823624.748448:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787823624.748451:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a26c600, rc 0) 00000100:00100000:3.0:1787823624.748610:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790aef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+24:11519:x1874668629868928:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 917us (1120us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1787823624.748618:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 187 00000100:00100000:3.0:1787823624.754305:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823624.754813:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629869056 00000100:00100000:0.0:1787823624.754831:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629869056 00000100:00100000:0.0:1787823624.754895:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 188 00000100:00100000:0.0:1787823624.754906:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+24:11519:x1874668629869056:12345-192.168.202.35@tcp:34:lfs.0 00010000:00010000:0.0:1787823624.754999:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482390 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.755017:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482390 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.755028:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482390 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.755044:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832482397 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.755052:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832482397 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.755058:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832482397 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.757035:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e200/0x5d1142b83248239e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.757059:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e200/0x5d1142b83248239e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.757071:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e200/0x5d1142b83248239e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787823624.757146:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e200/0x5d1142b83248239e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.757165:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482390 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.757172:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482390 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.757181:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482390 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.757191:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40ec00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823624.757196:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482390 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.757204:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482390 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.757224:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e7917859e00) 00010000:00010000:0.0:1787823624.757227:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823624.757233:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482390 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.757240:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482390 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.757259:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832482397 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.757266:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832482397 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.757466:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832482397 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.757478:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40fa00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823624.757482:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832482397 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.757488:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832482397 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.757502:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e791767bb00) 00010000:00010000:0.0:1787823624.757505:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823624.757509:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832482397 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.757514:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832482397 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.757538:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e200/0x5d1142b83248239e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.757562:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e200/0x5d1142b83248239e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.757569:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e200/0x5d1142b83248239e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.757575:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40e200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823624.757578:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e200/0x5d1142b83248239e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.757601:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e200/0x5d1142b83248239e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.757611:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e791767be00) 00010000:00010000:0.0:1787823624.757614:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823624.757617:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e200/0x5d1142b83248239e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.757628:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e200/0x5d1142b83248239e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823624.757784:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+24:11519:x1874668629869056:12345-192.168.202.35@tcp:34:lfs.0 Request processed in 2846us (3458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823624.757795:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 188 00000100:00100000:3.0:1787823624.837313:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823624.837813:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629869312 00000100:00100000:2.0:1787823624.837823:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629869312 00000100:00100000:2.0:1787823624.838438:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 189 00000100:00100000:2.0:1787823624.838450:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+24:11522:x1874668629869312:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:2.0:1787823624.838469:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823624.838489:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b8324823a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f449aa expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.838575:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b8324823ac lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.838591:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b8324823ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.838602:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b8324823ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.838615:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324823b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.838623:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324823b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.838629:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324823b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.839020:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b8324823ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.839036:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b8324823ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.839045:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b8324823ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787823624.839056:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787823624.839147:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b8324823ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.839155:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b8324823ac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.839163:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b8324823ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.839170:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d2800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823624.839175:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b8324823ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.839183:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b8324823ac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.839196:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e7917859e00) 00010000:00010000:2.0:1787823624.839200:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823624.839203:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b8324823ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.839210:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b8324823ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.839220:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324823b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.839233:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324823b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.839239:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324823b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.839245:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823624.839248:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324823b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.839255:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324823b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.839263:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e79228da800) 00010000:00010000:2.0:1787823624.839266:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823624.839269:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324823b3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.839648:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324823b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.839754:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b8324823a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449aa expref: 27 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.839793:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b8324823ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449aa expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.839800:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228da500) 00010000:00010000:2.0:1787823624.839802:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787823624.839810:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d2a00, rc 0) 00000100:00100000:2.0:1787823624.839876:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+26:11522:x1874668629869312:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 1428us (2571us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1787823624.839885:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 189 00000100:00100000:0.0:1787823624.848042:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823624.848125:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629869440 00000100:00100000:3.0:1787823624.848135:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629869440 00000100:00100000:3.0:1787823624.848209:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 190 00000100:00100000:3.0:1787823624.848218:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+26:11522:x1874668629869440:12345-192.168.202.35@tcp:54:lfs.0 00010000:00010000:3.0:1787823624.848298:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b8324823c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.848314:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b8324823c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.848326:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b8324823c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.848350:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b8324823c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.848357:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b8324823c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.848364:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b8324823c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.848370:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26d600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823624.848374:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b8324823c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.848381:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b8324823c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.848392:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228da500) 00010000:00010000:3.0:1787823624.848395:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787823624.848409:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b8324823c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.848417:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b8324823c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823624.848488:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+26:11522:x1874668629869440:12345-192.168.202.35@tcp:54:lfs.0 Request processed in 271us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823624.848495:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 190 00000100:00100000:3.0:1787823624.850227:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823624.850302:0:12014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629869696 00000100:00100000:1.0:1787823624.850309:0:12014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629869696 00000100:00100000:1.0:1787823624.850360:0:12014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 51 00000100:00100000:1.0:1787823624.850368:0:12014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:353832f0-fe7b-4d99-975c-a8041babed42+26:11522:x1874668629869696:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:1.0:1787823624.850590:0:12014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:353832f0-fe7b-4d99-975c-a8041babed42+27:11522:x1874668629869696:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 221us (368us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1787823624.850597:0:12014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 51 00000100:00100000:1.0:1787823624.889284:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823624.889454:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629869952 00000100:00100000:3.0:1787823624.889465:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629869952 00000100:00100000:3.0:1787823624.889530:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 191 00000100:00100000:3.0:1787823624.889551:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+27:11056:x1874668629869952:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:3.0:1787823624.889582:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823624.889603:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b8324823cf lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f449b1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.889750:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b8324823d6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.889844:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b8324823ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449aa expref: 28 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.889853:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b8324823d6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.889914:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b8324823ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449aa expref: 28 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.889966:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b8324823ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449aa expref: 28 pid: 5839 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823624.889981:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a2ee580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1874668651884928:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787823624.890090:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e791a680480 going to sleep for 11 seconds 00000100:00100000:0.0:1787823624.893426:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823624.893612:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a2ee580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1874668651884928:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787823624.893639:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b8324823d6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823624.893727:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629870080 00000100:00100000:1.0:1787823624.893734:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629870080 00010000:00010000:1.0:1787823624.893812:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b8324823ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449aa expref: 29 pid: 5839 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823624.893862:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 72 00000100:00100000:1.0:1787823624.893873:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ad50b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:353832f0-fe7b-4d99-975c-a8041babed42+29:2353:x1874668629870080:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787823624.893903:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823624.893911:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b8324823ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449aa expref: 29 pid: 5839 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.893925:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b8324823ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449aa expref: 29 pid: 5839 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.893947:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b8324823ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449aa expref: 29 pid: 5839 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.893965:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228da500) 00010000:00010000:1.0:1787823624.893970:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b8324823d6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.893980:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b8324823d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.893987:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b8324823d6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.894015:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823624.894073:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ad50b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:353832f0-fe7b-4d99-975c-a8041babed42+28:2353:x1874668629870080:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 201us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823624.894080:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 72 00010000:00010000:3.0:1787823624.894188:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b8324823d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.894197:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b8324823d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787823624.894215:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787823624.894379:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b8324823cf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449b1 expref: 29 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.894397:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b8324823d6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449b1 expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823624.894406:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228da500) 00010000:00010000:3.0:1787823624.894409:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787823624.894411:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a26dc00, rc 0) 00000100:00100000:3.0:1787823624.894436:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+28:11056:x1874668629869952:12345-192.168.202.35@tcp:101:bash.0 Request processed in 4897us (5175us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1787823624.894454:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 191 00000100:00100000:0.0:1787823624.898444:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823624.898564:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629870336 00000100:00100000:2.0:1787823624.898574:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629870336 00000100:00100000:2.0:1787823624.898630:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 192 00000100:00100000:2.0:1787823624.898639:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792eb06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+28:11056:x1874668629870336:12345-192.168.202.35@tcp:36:bash.0 00010000:00010000:2.0:1787823624.898961:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324823e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.898978:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324823e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.898989:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324823e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787823624.899035:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:2.0:1787823624.899055:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000afd19c95 reply state 000000003f607f37 transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324823e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823624.899064:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787823624.899101:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:2.0:1787823624.899183:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792eb06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+32:11056:x1874668629870336:12345-192.168.202.35@tcp:36:bash.0 Request processed in 544us (751us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1787823624.899191:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 192 00000020:00080000:2.0:1787823624.899195:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1787823624.902365:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324823e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.902396:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324823e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.902422:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324823e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.902428:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823624.902433:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324823e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.902453:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324823e4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.902470:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228da500) 00010000:00010000:1.0:1787823624.902473:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823624.902477:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324823e4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823624.902484:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324823e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823624.902614:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823624.902704:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629870464 00000100:00100000:0.0:1787823624.902713:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629870464 00000100:00100000:0.0:1787823624.902802:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 193 00000100:00100000:0.0:1787823624.902813:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+31:11056:x1874668629870464:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:0.0:1787823624.902833:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823624.902848:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b8324823eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f449b8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.902930:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b8324823eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449b8 expref: 32 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.902956:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b8324823eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449b8 expref: 32 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823624.902975:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228da500) 00010000:00010000:0.0:1787823624.902977:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787823624.902980:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40e600, rc 0) 00000100:00100000:0.0:1787823624.903041:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+32:11056:x1874668629870464:12345-192.168.202.35@tcp:101:bash.0 Request processed in 230us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823624.903048:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 193 00000100:00100000:0.0:1787823624.906892:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823624.907088:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629870592 00000100:00100000:2.0:1787823624.907099:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629870592 00000100:00100000:2.0:1787823624.907212:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 58 00000100:00100000:2.0:1787823624.907224:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792eb07c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:353832f0-fe7b-4d99-975c-a8041babed42+7:11056:x1874668629870592:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:2.0:1787823624.907242:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823624.907263:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b672e8a/0x5d1142b8324823f2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f449bf expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787823624.907300:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a900607, atime: 0x6a900605, ctime: 0x6a900607, blocks: 0xb 00010000:00010000:2.0:1787823624.907323:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=365s v=(0 0) 00010000:00010000:2.0:1787823624.907328:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823624.907346:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b672e8a/0x5d1142b8324823f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449bf expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.907362:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000b672e8a/0x5d1142b8324823f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449bf expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823624.907375:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d2200, rc 0) 00000100:00100000:2.0:1787823624.907499:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792eb07c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:353832f0-fe7b-4d99-975c-a8041babed42+8:11056:x1874668629870592:12345-192.168.202.35@tcp:101:bash.0 Request processed in 276us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823624.907513:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 58 00000100:00100000:2.0:1787823624.911652:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823624.916537:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629870720 00000100:00100000:1.0:1787823624.916567:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629870720 00002000:00010000:1.0:1787823624.916638:0:6692:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1787823624.916643:0:6692:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8e793f99b480 with x1874668629870720 ext(0->18446744073709551615) 00002000:00010000:1.0:1787823624.916656:0:6692:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e793f99b480. 00000100:00100000:0.0:1787823624.916787:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 5 00000100:00100000:0.0:1787823624.916800:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f99b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:353832f0-fe7b-4d99-975c-a8041babed42+8:2352:x1874668629870720:12345-192.168.202.35@tcp:10:bash.0 00002000:00010000:0.0:1787823624.917125:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787823624.917129:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787823623 -> 1787823625 00002000:00010000:0.0:1787823624.917132:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1787823621 -> 1787823621 00002000:00010000:0.0:1787823624.917134:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787823623 -> 1787823625 00002000:00010000:0.0:1787823624.917137:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787823624.917224:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f99b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:353832f0-fe7b-4d99-975c-a8041babed42+9:2352:x1874668629870720:12345-192.168.202.35@tcp:10:bash.0 Request processed in 427us (5589us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1787823624.917232:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 5 00002000:00010000:0.0:1787823624.917236:0:6693:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1787823624.917240:0:6693:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8e793f99b480 with x1874668629870720 ext(0->18446744073709551615) 00002000:00010000:0.0:1787823624.917244:0:6693:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e793f99b480. 00000100:00100000:1.0:1787823625.000102:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823625.000207:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629870848 00000100:00100000:2.0:1787823625.000217:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629870848 00000100:00100000:2.0:1787823625.000290:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 194 00000100:00100000:2.0:1787823625.000301:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+32:11536:x1874668629870848:12345-192.168.202.35@tcp:34:lfs.0 00010000:00010000:2.0:1787823625.000379:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b8324823f9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.000414:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b8324823f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.000426:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b8324823f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.000443:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482400 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.000451:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482400 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.000458:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482400 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.000851:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482407 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.000861:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482407 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.000868:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482407 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787823625.000921:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482407 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.000935:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b8324823f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.000942:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b8324823f9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.000958:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b8324823f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.000963:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823625.000967:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b8324823f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.000974:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b8324823f9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.000986:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e7917859e00) 00010000:00010000:2.0:1787823625.000989:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823625.000993:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b8324823f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.001000:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b8324823f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.001011:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482400 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.001017:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482400 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.001023:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482400 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.001028:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823625.001030:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482400 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.001046:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482400 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.001055:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e79228da600) 00010000:00010000:2.0:1787823625.001057:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823625.001060:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482400 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.001066:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482400 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.001079:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482407 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.001085:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482407 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.001090:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482407 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.001095:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d2800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823625.001098:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482407 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.001103:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482407 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.001110:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228da500) 00010000:00010000:2.0:1787823625.001112:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823625.001115:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482407 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.001130:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482407 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823625.001204:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+32:11536:x1874668629870848:12345-192.168.202.35@tcp:34:lfs.0 Request processed in 903us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823625.001213:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 194 00000100:00100000:2.0:1787823625.034381:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823625.034474:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629871104 00000100:00100000:0.0:1787823625.034500:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629871104 00000100:00100000:0.0:1787823625.034620:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 195 00000100:00100000:0.0:1787823625.034630:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+32:11539:x1874668629871104:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787823625.034649:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823625.034671:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b83248240e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f449c6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.034773:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832482415 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.034790:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832482415 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.034801:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832482415 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.034817:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e200/0x5d1142b83248241c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.034825:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e200/0x5d1142b83248241c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.034831:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e200/0x5d1142b83248241c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.035493:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832482423 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.035505:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832482423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.035513:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832482423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787823625.035530:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787823625.035640:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832482415 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.035649:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832482415 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.035656:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832482415 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.035662:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40fa00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823625.035666:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832482415 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.035674:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832482415 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.035699:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e7917859e00) 00010000:00010000:0.0:1787823625.035702:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823625.035707:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832482415 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.035714:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832482415 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.035728:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e200/0x5d1142b83248241c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.035734:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e200/0x5d1142b83248241c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.035752:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e200/0x5d1142b83248241c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.035805:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40e200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823625.035809:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e200/0x5d1142b83248241c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.035817:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e200/0x5d1142b83248241c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.035826:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e791767be00) 00010000:00010000:0.0:1787823625.035829:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823625.035832:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e200/0x5d1142b83248241c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.035838:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e200/0x5d1142b83248241c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.036352:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b83248240e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449c6 expref: 35 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.036369:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832482423 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449c6 expref: 34 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.036376:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228da500) 00010000:00010000:0.0:1787823625.036379:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787823625.036381:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40f800, rc 0) 00000100:00100000:0.0:1787823625.036591:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+34:11539:x1874668629871104:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 1961us (2220us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1787823625.036610:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 195 00000100:00100000:0.0:1787823625.039639:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823625.039726:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629871232 00000100:00100000:2.0:1787823625.039736:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629871232 00000100:00100000:2.0:1787823625.039815:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 196 00000100:00100000:2.0:1787823625.039826:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792eb05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+34:11539:x1874668629871232:12345-192.168.202.35@tcp:54:lfs.0 00010000:00010000:2.0:1787823625.039902:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482431 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.039922:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b8324823d6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449b1 expref: 34 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.039932:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482431 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.039967:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b8324823d6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449b1 expref: 34 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.039982:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b8324823d6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449b1 expref: 34 pid: 5838 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823625.039996:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e791ac86940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1874668651885056:192.168.202.35@tcp:104: 00000100:00100000:2.0:1787823625.040716:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e780118e180 going to sleep for 11 seconds 00000100:00100000:0.0:1787823625.042632:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e791ac86940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1874668651885056:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787823625.042660:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482431 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823625.043282:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823625.043598:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629871488 00000100:00100000:2.0:1787823625.043606:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629871488 00000100:00100000:2.0:1787823625.043651:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 52 00000100:00100000:2.0:1787823625.043661:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+35:5593:x1874668629871488:12345-192.168.202.35@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787823625.044002:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+36:5593:x1874668629871488:12345-192.168.202.35@tcp:35:ldlm_bl.0 Request processed in 341us (720us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1787823625.044010:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 52 00000100:00100000:2.0:1787823625.046992:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823625.047079:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629871616 00000100:00100000:1.0:1787823625.047150:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629871616 00010000:00010000:1.0:1787823625.047188:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b8324823d6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449b1 expref: 36 pid: 5838 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823625.047228:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 73 00000100:00100000:1.0:1787823625.047252:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ac86940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:353832f0-fe7b-4d99-975c-a8041babed42+36:2353:x1874668629871616:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787823625.047369:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823625.047378:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b8324823d6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449b1 expref: 36 pid: 5838 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.047391:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b8324823d6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449b1 expref: 36 pid: 5838 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.047415:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26dc00/0x5d1142b8324823d6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449b1 expref: 36 pid: 5838 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.047432:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228da500) 00010000:00010000:1.0:1787823625.047437:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482431 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.047446:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482431 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.047454:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482431 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.047580:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823625.047644:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ac86940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:353832f0-fe7b-4d99-975c-a8041babed42+35:2353:x1874668629871616:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 392us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823625.047651:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 73 00010000:00010000:0.0:1787823625.049906:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482431 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.049922:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482431 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.049957:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482431 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.049964:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482431 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.049972:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482431 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.049979:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823625.049983:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482431 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.049989:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482431 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.050005:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228da500) 00010000:00010000:0.0:1787823625.050023:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787823625.050028:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482431 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.050035:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482431 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823625.050231:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792eb05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+34:11539:x1874668629871232:12345-192.168.202.35@tcp:54:lfs.0 Request processed in 10403us (10596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823625.050241:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 196 00000100:00100000:2.0:1787823625.053244:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823625.053386:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629871872 00000100:00100000:3.0:1787823625.053396:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629871872 00000100:00100000:3.0:1787823625.053493:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 53 00000100:00100000:3.0:1787823625.053504:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926245a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+34:11539:x1874668629871872:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:3.0:1787823625.053747:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926245a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+35:11539:x1874668629871872:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 244us (511us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1787823625.053755:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 53 00000100:00100000:2.0:1787823625.139645:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823625.139789:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629872128 00000100:00100000:1.0:1787823625.139799:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629872128 00000100:00100000:1.0:1787823625.139869:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 197 00000100:00100000:1.0:1787823625.139880:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+35:11550:x1874668629872128:12345-192.168.202.35@tcp:101:cat.0 00010000:00010000:1.0:1787823625.139922:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823625.139943:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482438 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f449cd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.140015:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b83248243f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.140030:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b83248243f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.140042:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b83248243f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.140056:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832482446 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.140064:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832482446 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.140071:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832482446 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.140393:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b83248244d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.140404:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b83248244d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.140412:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b83248244d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787823625.140422:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1787823625.140521:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b83248243f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.140529:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b83248243f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.140536:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b83248243f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.140556:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eea400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823625.140560:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b83248243f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.140568:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b83248243f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.140581:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e7917859e00) 00010000:00010000:1.0:1787823625.140585:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823625.140591:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b83248243f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.140597:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b83248243f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.140611:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832482446 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.140618:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832482446 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.140624:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832482446 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.140629:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eeac00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823625.140639:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832482446 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.140646:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832482446 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.140654:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e7917859700) 00010000:00010000:1.0:1787823625.140657:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823625.140660:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832482446 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.140666:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832482446 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.141072:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482438 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449cd expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.141088:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b83248244d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449cd expref: 37 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.141096:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228da500) 00010000:00010000:1.0:1787823625.141099:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787823625.141101:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7920eea600, rc 0) 00000100:00100000:1.0:1787823625.141157:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+37:11550:x1874668629872128:12345-192.168.202.35@tcp:101:cat.0 Request processed in 1278us (1521us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1787823625.141165:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 197 00000100:00100000:0.0:1787823625.148138:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823625.148223:0:12014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629872384 00000100:00100000:1.0:1787823625.148233:0:12014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629872384 00000100:00100000:1.0:1787823625.148299:0:12014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 54 00000100:00100000:1.0:1787823625.148310:0:12014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:353832f0-fe7b-4d99-975c-a8041babed42+37:11550:x1874668629872384:12345-192.168.202.35@tcp:35:cat.0 00000100:00100000:1.0:1787823625.148607:0:12014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:353832f0-fe7b-4d99-975c-a8041babed42+38:11550:x1874668629872384:12345-192.168.202.35@tcp:35:cat.0 Request processed in 298us (478us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1787823625.148616:0:12014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 54 00000100:00100000:2.0:1787823625.168662:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823625.168821:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629872640 00000100:00100000:3.0:1787823625.168832:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629872640 00000100:00100000:3.0:1787823625.168904:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 198 00000100:00100000:3.0:1787823625.168914:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+38:11551:x1874668629872640:12345-192.168.202.35@tcp:36:rm.0 00010000:00010000:3.0:1787823625.168970:0:7893:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787823625.169000:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b83248244d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449cd expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823625.169025:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832482423 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449c6 expref: 37 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823625.169039:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e600/0x5d1142b8324823eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449b8 expref: 36 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823625.169049:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79228da500) 00010000:00010000:3.0:1787823625.169060:0:7893:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787823625.169082:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b83248245b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823625.169110:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b83248245b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823625.169120:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b83248245b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823625.169136:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26cc00/0x5d1142b832482462 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823625.169144:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26cc00/0x5d1142b832482462 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823625.169151:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26cc00/0x5d1142b832482462 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823625.169450:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482469 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823625.169460:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482469 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823625.169467:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482469 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787823625.170140:0:7893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:3.0:1787823625.170152:0:7893:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 366024392188ns, next at 367024389475ns, rc = 0 00010000:00010000:3.0:1787823625.170212:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ca00/0x5d1142b832482470 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823625.170224:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ca00/0x5d1142b832482470 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823625.170244:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ca00/0x5d1142b832482470 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823625.170252:0:7893:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ca00/0x5d1142b832482470 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823625.170259:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ca00/0x5d1142b832482470 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823625.170266:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ca00/0x5d1142b832482470 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823625.170294:0:7893:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787823625.170313:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482469 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823625.170320:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482469 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823625.170326:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482469 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823625.170333:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26de00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823625.170337:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482469 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823625.170345:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482469 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823625.170356:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79087c9d00) 00010000:00010000:3.0:1787823625.170359:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787823625.170369:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482469 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823625.170376:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482469 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823625.170394:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b83248245b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823625.170401:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b83248245b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823625.170407:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b83248245b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823625.170412:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26d600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823625.170415:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b83248245b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823625.170421:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b83248245b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823625.170429:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e7917859e00) 00010000:00010000:3.0:1787823625.170432:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787823625.170435:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b83248245b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823625.170442:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b83248245b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787823625.170450:0:7893:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000010720ddf reply state 000000002e0df488 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26cc00/0x5d1142b832482462 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823625.170470:0:7893:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787823625.170571:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+37:11551:x1874668629872640:12345-192.168.202.35@tcp:36:rm.0 Request processed in 1656us (1918us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1787823625.170580:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 198 00010000:00010000:2.0:1787823625.171219:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787823625.171227:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ca00/0x5d1142b832482470 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.171235:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26ca00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:2.0:1787823625.171239:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ca00/0x5d1142b832482470 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.171247:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ca00/0x5d1142b832482470 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.171268:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e79087c9d00) 00010000:00010000:2.0:1787823625.171272:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787823625.171276:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ca00/0x5d1142b832482470 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.171283:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ca00/0x5d1142b832482470 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.171310:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823625.171312:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823625.171313:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823625.173407:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26cc00/0x5d1142b832482462 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.173424:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26cc00/0x5d1142b832482462 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.173432:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26cc00/0x5d1142b832482462 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.173439:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26cc00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823625.173444:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26cc00/0x5d1142b832482462 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.173452:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26cc00/0x5d1142b832482462 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.173469:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e79087c9f00) 00010000:00010000:2.0:1787823625.173472:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823625.173477:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26cc00/0x5d1142b832482462 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.173482:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26cc00/0x5d1142b832482462 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823625.219371:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823625.219487:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629872896 00000100:00100000:1.0:1787823625.219498:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629872896 00000100:00100000:1.0:1787823625.219569:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 199 00000100:00100000:1.0:1787823625.219581:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79360bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+36:11557:x1874668629872896:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:1.0:1787823625.219609:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823625.219635:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482477 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f449d4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.219830:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b83248247e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.219847:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b83248247e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.219860:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b83248247e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.219874:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b832482485 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.219881:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b832482485 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.219887:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b832482485 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787823625.220467:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1787823625.220641:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b83248248c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.220652:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b83248248c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.220660:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b83248248c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.220690:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b83248247e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.220697:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b83248247e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.220704:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b83248247e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.220710:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eeac00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823625.220715:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b83248247e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.220722:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b83248247e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.220734:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e7917859e00) 00010000:00010000:1.0:1787823625.220737:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823625.220741:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b83248247e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.220747:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b83248247e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787823625.220799:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd2fff25 reply state 00000000ea353e17 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b832482485 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823625.220808:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787823625.220836:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482477 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449d4 expref: 39 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.220850:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b83248248c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449d4 expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.220857:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e7917859f00) 00010000:00010000:1.0:1787823625.220859:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787823625.220862:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7920eebc00, rc 0) 00000100:00100000:1.0:1787823625.220940:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79360bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+39:11557:x1874668629872896:12345-192.168.202.35@tcp:101:bash.0 Request processed in 1361us (1580us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1787823625.220948:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 199 00010000:00010000:1.0:1787823625.224802:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b832482485 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.224822:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b832482485 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.224830:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b832482485 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.224837:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eea400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823625.224842:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b832482485 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.224878:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b832482485 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.224897:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e7917859700) 00010000:00010000:1.0:1787823625.224900:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823625.224905:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b832482485 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.224911:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b832482485 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823625.225837:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823625.225992:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629873024 00000100:00100000:1.0:1787823625.226001:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629873024 00000100:00100000:1.0:1787823625.226064:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 59 00000100:00100000:1.0:1787823625.226076:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79360b8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+5:2353:x1874668629873024:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:1.0:1787823625.226099:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823625.226120:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6e8b871/0x5d1142b83248249a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f449db expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787823625.226149:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787823625.226168:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=366s v=(0 0) 00010000:00010000:1.0:1787823625.226173:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787823625.226183:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6e8b871/0x5d1142b83248249a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449db expref: 6 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.226202:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6e8b871/0x5d1142b83248249a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449db expref: 6 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.226236:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7920eea600, rc 0) 00000100:00100000:1.0:1787823625.226300:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79360b8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+6:2353:x1874668629873024:12345-192.168.202.35@tcp:101:bash.0 Request processed in 225us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823625.226308:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 59 00000100:00080000:0.0:1787823625.227001:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787823625.230231:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823625.230389:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629873152 00000100:00100000:2.0:1787823625.230420:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629873152 00000100:00100000:2.0:1787823625.230491:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 60 00000100:00100000:2.0:1787823625.230502:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+6:11557:x1874668629873152:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:2.0:1787823625.230521:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823625.230548:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032570d00/0x5d1142b8324824a1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f449e2 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.230584:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6e8b871/0x5d1142b83248249a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449db expref: 7 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.230593:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823625.230597:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823625.230602:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032570d00/0x5d1142b8324824a1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449e2 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.230635:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d6e8b871/0x5d1142b83248249a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449db expref: 7 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.230648:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d6e8b871/0x5d1142b83248249a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449db expref: 7 pid: 6686 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823625.230662:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e79360b9a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6687:1874668651885184:192.168.202.35@tcp:104: 00000100:00100000:2.0:1787823625.230802:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e780118ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1787823625.236670:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e79360b9a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6687:1874668651885184:192.168.202.35@tcp:104: 00010000:00010000:2.0:1787823625.236716:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000032570d00/0x5d1142b8324824a1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449e2 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.236790:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d3a00, rc 0) 00000100:00100000:2.0:1787823625.236847:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+7:11557:x1874668629873152:12345-192.168.202.35@tcp:101:bash.0 Request processed in 6346us (6627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823625.236856:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 60 00000100:00100000:3.0:1787823625.238871:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823625.239166:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629873280 00000100:00100000:0.0:1787823625.239176:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629873280 00010000:00010000:0.0:1787823625.239216:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d6e8b871/0x5d1142b83248249a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449db expref: 7 pid: 6686 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823625.239261:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 74 00000100:00100000:0.0:1787823625.239280:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2ee580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:353832f0-fe7b-4d99-975c-a8041babed42+7:2352:x1874668629873280:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787823625.239296:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787823625.239317:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d6e8b871/0x5d1142b83248249a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449db expref: 7 pid: 6686 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.239332:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d6e8b871/0x5d1142b83248249a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449db expref: 7 pid: 6686 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.239355:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6e8b871/0x5d1142b83248249a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449db expref: 7 pid: 6686 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.239385:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787823625.239390:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787823625.239398:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000032570d00/0x5d1142b8324824a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449e2 expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.239409:0:8457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032570d00/0x5d1142b8324824a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449e2 expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.239445:0:8457:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000032570d00/0x5d1142b8324824a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449e2 expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823625.239460:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec4da40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8457:1874668651885312:192.168.202.35@tcp:105: 00000100:00100000:0.0:1787823625.239549:0:8457:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7904707540 going to sleep for 11 seconds 00000100:00100000:0.0:1787823625.243042:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823625.243126:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629873536 00000100:00100000:1.0:1787823625.243135:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629873536 00000100:00100000:1.0:1787823625.243189:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 55 00000100:00100000:1.0:1787823625.243199:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+38:11557:x1874668629873536:12345-192.168.202.35@tcp:35:bash.0 00000100:00100000:1.0:1787823625.243533:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+39:11557:x1874668629873536:12345-192.168.202.35@tcp:35:bash.0 Request processed in 334us (499us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1787823625.243555:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 55 00000100:00100000:3.0:1787823625.243867:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec4da40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8457:1874668651885312:192.168.202.35@tcp:105: 00010000:00010000:3.0:1787823625.243890:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787823625.243914:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2ee580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:353832f0-fe7b-4d99-975c-a8041babed42+6:2352:x1874668629873280:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 4636us (5064us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823625.243922:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 74 00000100:00100000:3.0:1787823625.433447:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823625.440847:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629873664 00000100:00100000:0.0:1787823625.440875:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629873664 00000100:00100000:0.0:1787823625.440972:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 200 00000100:00100000:0.0:1787823625.440985:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+39:11573:x1874668629873664:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787823625.441009:0:7893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823625.441028:0:7893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f400/0x5d1142b8324824a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f449e9 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.441091:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b8324824af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.441122:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b8324824af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.441135:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b8324824af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787823625.441194:0:7893:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787823625.441198:0:7893:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787823625.441221:0:7893:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b8324824af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.441247:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f400/0x5d1142b8324824a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449e9 expref: 41 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.441280:0:7893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b8324824af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449e9 expref: 40 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.441290:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e7917859e00) 00010000:00010000:0.0:1787823625.441294:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787823625.441298:0:7893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40f000, rc 0) 00000100:00100000:0.0:1787823625.441377:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+40:11573:x1874668629873664:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 395us (7943us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823625.441385:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 200 00000100:00100000:3.0:1787823625.447968:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823625.448120:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629873920 00000100:00100000:1.0:1787823625.448130:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629873920 00000100:00100000:1.0:1787823625.448192:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 201 00000100:00100000:1.0:1787823625.448203:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922b8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+40:11573:x1874668629873920:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:1.0:1787823625.448228:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823625.448251:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b8324824b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f449f0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.448371:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b8324824bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.448386:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b8324824bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.448397:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b8324824bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787823625.448425:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787823625.448567:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b8324824b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449f0 expref: 43 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.448587:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b8324824bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449f0 expref: 42 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.448595:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e7917859f00) 00010000:00010000:1.0:1787823625.448597:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787823625.448601:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7920eeac00, rc 0) 00000100:00100000:1.0:1787823625.448671:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922b8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+42:11573:x1874668629873920:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 470us (712us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1787823625.448979:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 201 00010000:00010000:1.0:1787823625.453223:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823625.463330:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823625.463380:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823625.463567:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629874176 00000100:00100000:0.0:1787823625.463578:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629874176 00000100:00100000:0.0:1787823625.463650:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 202 00000100:00100000:0.0:1787823625.463660:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+42:11573:x1874668629874176:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787823625.463685:0:7893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823625.463722:0:7893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b8324824cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f449f7 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.463864:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f400/0x5d1142b8324824d2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.463879:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f400/0x5d1142b8324824d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.463891:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f400/0x5d1142b8324824d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787823625.463902:0:7893:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787823625.464040:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b8324824cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449f7 expref: 45 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.464059:0:7893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f400/0x5d1142b8324824d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449f7 expref: 44 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.464068:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e7917859f00) 00010000:00010000:0.0:1787823625.464071:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787823625.464074:0:7893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40f400, rc 0) 00000100:00100000:0.0:1787823625.464127:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+44:11573:x1874668629874176:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 469us (806us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1787823625.464134:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 202 00000100:00100000:2.0:1787823625.464254:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629874304 00000100:00100000:2.0:1787823625.464259:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629874304 00000100:00100000:2.0:1787823625.464308:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 15 00000100:00100000:2.0:1787823625.464316:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79037f0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:353832f0-fe7b-4d99-975c-a8041babed42+44:2352:x1874668629874304:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787823625.464327:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787823625.464343:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b8324824bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449f0 expref: 44 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.464356:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e7917859f00) 00010000:00010000:2.0:1787823625.464359:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787823625.464380:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79037f0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:353832f0-fe7b-4d99-975c-a8041babed42+43:2352:x1874668629874304:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 66us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823625.464388:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 15 00000100:00100000:3.0:1787823625.472301:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823625.472627:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629874432 00000100:00100000:2.0:1787823625.472638:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629874432 00000100:00100000:2.0:1787823625.472701:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 61 00000100:00100000:2.0:1787823625.472711:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922b89a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:353832f0-fe7b-4d99-975c-a8041babed42+6:2353:x1874668629874432:12345-192.168.202.35@tcp:1:lfs.0 00010000:00010000:2.0:1787823625.472787:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f22558c3/0x5d1142b8324824e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.473040:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000032570d00/0x5d1142b8324824a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449e2 expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.473061:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823625.473066:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787823625.473072:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f22558c3/0x5d1142b8324824e0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.473109:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000032570d00/0x5d1142b8324824a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449e2 expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.473125:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000032570d00/0x5d1142b8324824a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449e2 expref: 6 pid: 6687 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823625.473142:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e79360b9a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6688:1874668651885440:192.168.202.35@tcp:104: 00000100:00100000:2.0:1787823625.473243:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e780118e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787823625.476834:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e79360b9a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6688:1874668651885440:192.168.202.35@tcp:104: 00010000:00010000:2.0:1787823625.476869:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f22558c3/0x5d1142b8324824e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823625.477908:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823625.478018:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629874560 00000100:00100000:2.0:1787823625.478027:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629874560 00002000:00100000:2.0:1787823625.478084:0:6691:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8e7922b88f00 x1874668629874560/t0(0) o4->353832f0-fe7b-4d99-975c-a8041babed42@192.168.202.35@tcp:246/0 lens 504/0 e 0 to 0 dl 1787823636 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787823625.478096:0:6691:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8e7922b88f00 with x1874668629874560 ext(0->8) 00010000:00010000:2.0:1787823625.478105:0:6691:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000032570d00/0x5d1142b8324824a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449e2 expref: 7 pid: 6687 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.478143:0:6691:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000032570d00/0x5d1142b8324824a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449e2 expref: 7 pid: 6687 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787823625.478151:0:6691:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e7922b88f00 00000100:00100000:2.0:1787823625.478188:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 3 00000100:00100000:2.0:1787823625.478199:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922b88f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:353832f0-fe7b-4d99-975c-a8041babed42+7:2352:x1874668629874560:12345-192.168.202.35@tcp:4:lfs.0 00000100:00100000:2.0:1787823625.479287:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922b88f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:353832f0-fe7b-4d99-975c-a8041babed42+9:2352:x1874668629874560:12345-192.168.202.35@tcp:4:lfs.0 Request processed in 1084us (1377us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787823625.479298:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 3 00002000:00100000:2.0:1787823625.479307:0:6691:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8e7922b88f00 x1874668629874560/t4294967308(0) o4->353832f0-fe7b-4d99-975c-a8041babed42@192.168.202.35@tcp:246/0 lens 504/448 e 0 to 0 dl 1787823636 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787823625.479318:0:6691:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8e7922b88f00 with x1874668629874560 ext(0->8) 00010000:00010000:2.0:1787823625.479326:0:6691:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000032570d00/0x5d1142b8324824a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449e2 expref: 9 pid: 6687 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.479345:0:6691:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000032570d00/0x5d1142b8324824a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449e2 expref: 9 pid: 6687 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787823625.479353:0:6691:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e7922b88f00 00000100:00100000:3.0:1787823625.485854:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823625.486000:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629874688 00000100:00100000:1.0:1787823625.486011:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629874688 00010000:00010000:1.0:1787823625.486052:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000032570d00/0x5d1142b8324824a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449e2 expref: 9 pid: 6687 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823625.486106:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 75 00000100:00100000:1.0:1787823625.486118:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922b89e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:353832f0-fe7b-4d99-975c-a8041babed42+9:2355:x1874668629874688:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787823625.486135:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787823625.486159:0:5824:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787823625.486163:0:5824:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787823625 00002000:00010000:1.0:1787823625.486179:0:5824:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787823626 00002000:00010000:1.0:1787823625.486181:0:5824:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787823625 00010000:00010000:1.0:1787823625.486188:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000032570d00/0x5d1142b8324824a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449e2 expref: 9 pid: 6687 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.486202:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000032570d00/0x5d1142b8324824a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449e2 expref: 9 pid: 6687 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.486226:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032570d00/0x5d1142b8324824a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449e2 expref: 9 pid: 6687 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.486243:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787823625.486248:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787823625.486254:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f22558c3/0x5d1142b8324824e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.486264:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f22558c3/0x5d1142b8324824e0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.486296:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823625.486352:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922b89e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:353832f0-fe7b-4d99-975c-a8041babed42+8:2355:x1874668629874688:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 236us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823625.486361:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 75 00010000:00010000:2.0:1787823625.486431:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f22558c3/0x5d1142b8324824e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.486440:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f22558c3/0x5d1142b8324824e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.486484:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f22558c3/0x5d1142b8324824e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.486493:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f22558c3/0x5d1142b8324824e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.486501:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f22558c3/0x5d1142b8324824e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.486508:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d2c00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:2.0:1787823625.486512:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f22558c3/0x5d1142b8324824e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.486520:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f22558c3/0x5d1142b8324824e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.486534:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f22558c3/0x5d1142b8324824e0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.486555:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f22558c3/0x5d1142b8324824e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823625.486613:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922b89a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:353832f0-fe7b-4d99-975c-a8041babed42+7:2353:x1874668629874432:12345-192.168.202.35@tcp:1:lfs.0 Request processed in 13902us (14322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823625.486621:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 61 00000100:00100000:3.0:1787823625.492224:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823625.492333:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629874944 00000100:00100000:0.0:1787823625.492343:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629874944 00000100:00100000:0.0:1787823625.492406:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 56 00000100:00100000:0.0:1787823625.492417:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7925a91c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+43:11573:x1874668629874944:12345-192.168.202.35@tcp:35:lfs.0 00000004:00010000:0.0:1787823625.492498:0:5842:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f400/0x5d1142b8324824d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449f7 expref: 43 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787823625.492824:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1787823625.492874:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:0.0:1787823625.493220:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:0.0:1787823625.493276:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b8324824e7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.493292:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b83248248c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449d4 expref: 47 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.493301:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b8324824e7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.493335:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b83248248c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449d4 expref: 47 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.493351:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b83248248c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449d4 expref: 47 pid: 5838 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823625.493365:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec4da40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5842:1874668651885568:192.168.202.35@tcp:104: 00000100:00100000:0.0:1787823625.493445:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7904707780 going to sleep for 11 seconds 00000100:00100000:3.0:1787823625.496053:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823625.496131:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629875072 00000100:00100000:1.0:1787823625.496142:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629875072 00010000:00010000:1.0:1787823625.496181:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b83248248c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449d4 expref: 48 pid: 5838 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823625.496242:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 76 00000100:00100000:1.0:1787823625.496252:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922b883c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:353832f0-fe7b-4d99-975c-a8041babed42+48:2353:x1874668629875072:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787823625.496278:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823625.496286:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b83248248c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449d4 expref: 48 pid: 5838 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.496299:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b83248248c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449d4 expref: 48 pid: 5838 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.496321:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e7917859f00) 00010000:00010000:1.0:1787823625.496327:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b8324824e7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.496336:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b8324824e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.496343:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b8324824e7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.496361:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823625.496415:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922b883c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:353832f0-fe7b-4d99-975c-a8041babed42+48:2353:x1874668629875072:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 163us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823625.496423:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 76 00010000:00010000:0.0:1787823625.497219:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b83248248c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449d4 expref: 47 pid: 5838 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823625.497239:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec4da40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5842:1874668651885568:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787823625.497275:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b8324824e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.497296:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b8324824e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.497302:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b8324824e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787823625.497428:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:0.0:1787823625.497650:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1787823625.497815:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec4da40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1874668651885696:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787823625.497871:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823625.497907:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7904707e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787823625.497950:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651885696 00000100:00100000:2.0:1787823625.497956:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651885696 00000100:00100000:2.0:1787823625.498001:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787823625.498009:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926195a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1874668651885696:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787823625.498093:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926195a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1874668651885696:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 85us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823625.498101:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787823625.498414:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec4da40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1874668651885696:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787823625.499190:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:1.0:1787823625.499269:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec4da40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1874668651885824:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787823625.499335:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823625.499369:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79100b99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787823625.499546:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651885824 00000100:00100000:2.0:1787823625.499553:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651885824 00000100:00100000:2.0:1787823625.499605:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787823625.499614:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fd70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1874668651885824:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787823625.499801:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fd70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5842:x1874668651885824:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 188us (464us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787823625.499809:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787823625.502697:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec4da40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1874668651885824:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787823625.502830:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1787823625.502909:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b8324824e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.502928:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b8324824e7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.502935:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b8324824e7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.502940:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40ea00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823625.502945:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b8324824e7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.502952:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b8324824e7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.502968:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e7917859f00) 00010000:00010000:1.0:1787823625.502970:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787823625.502975:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b8324824e7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.502981:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ea00/0x5d1142b8324824e7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787823625.503193:0:5842:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787823625.503281:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1787823625.503292:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 366357532530ns, next at 367357530780ns, rc = 0 00000001:00080000:1.0:1787823625.503310:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:1.0:1787823625.503343:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e7917859f00) 00010000:00010000:1.0:1787823625.503346:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787823625.503353:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f400/0x5d1142b8324824d2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449f7 expref: 51 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823625.503886:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7925a91c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+50:11573:x1874668629874944:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 11468us (11670us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1787823625.503896:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 56 00000020:00080000:1.0:1787823625.503902:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787823625.509706:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823625.509821:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629875200 00000100:00100000:0.0:1787823625.509831:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629875200 00000100:00100000:0.0:1787823625.509886:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 203 00000100:00100000:0.0:1787823625.509897:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790ae80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+50:11573:x1874668629875200:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787823625.509923:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823625.509946:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b8324824ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f449fe expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.510011:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b8324824ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449fe expref: 51 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.510026:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b8324824ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449fe expref: 51 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.510043:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e791767be00) 00010000:00010000:0.0:1787823625.510047:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787823625.510064:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40f800, rc 0) 00000100:00100000:0.0:1787823625.510127:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790ae80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+51:11573:x1874668629875200:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 231us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823625.510134:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 203 00000100:00100000:0.0:1787823625.520358:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823625.520524:0:12014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629875456 00000100:00100000:1.0:1787823625.520534:0:12014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629875456 00000100:00100000:1.0:1787823625.520647:0:12014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 57 00000100:00100000:1.0:1787823625.520657:0:12014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926197c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:353832f0-fe7b-4d99-975c-a8041babed42+51:11573:x1874668629875456:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:1.0:1787823625.520946:0:12014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926197c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:353832f0-fe7b-4d99-975c-a8041babed42+52:11573:x1874668629875456:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 289us (598us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1787823625.520954:0:12014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 57 00000100:00100000:3.0:1787823625.616516:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823625.616744:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629875584 00000100:00100000:0.0:1787823625.616805:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629875584 00000100:00100000:0.0:1787823625.616882:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 204 00000100:00100000:0.0:1787823625.616893:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790ae830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+52:11583:x1874668629875584:12345-192.168.202.35@tcp:34:lfs.0 00010000:00010000:0.0:1787823625.616989:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b8324824f5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.617008:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b8324824f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.617019:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b8324824f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.617035:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b8324824fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.617042:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b8324824fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.617049:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b8324824fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.617157:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832482503 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.617167:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832482503 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.617190:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832482503 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787823625.617237:0:7893:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832482503 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.617251:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b8324824f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.617257:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b8324824f5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.617265:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b8324824f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.617271:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40ec00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823625.617277:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b8324824f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.617286:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b8324824f5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.617298:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e7917859e00) 00010000:00010000:0.0:1787823625.617301:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823625.617306:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b8324824f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.617313:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b8324824f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.617327:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b8324824fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.617338:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b8324824fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.617344:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b8324824fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.617349:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40fa00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823625.617352:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b8324824fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.617358:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b8324824fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.617367:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e791767bb00) 00010000:00010000:0.0:1787823625.617370:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823625.617372:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b8324824fc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.617378:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b8324824fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.617393:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832482503 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.617399:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832482503 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.617404:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832482503 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.617410:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40e000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823625.617419:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832482503 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.617425:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832482503 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.617432:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e791767be00) 00010000:00010000:0.0:1787823625.617435:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823625.617438:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832482503 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.617443:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832482503 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823625.617552:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790ae830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+52:11583:x1874668629875584:12345-192.168.202.35@tcp:34:lfs.0 Request processed in 659us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823625.617562:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 204 00000100:00100000:0.0:1787823625.667096:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823625.667194:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629875840 00000100:00100000:1.0:1787823625.667203:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629875840 00000100:00100000:1.0:1787823625.667278:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 205 00000100:00100000:1.0:1787823625.667288:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79351692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+52:11586:x1874668629875840:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:1.0:1787823625.667309:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823625.667330:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b83248250a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44a05 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.667426:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832482511 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.667451:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832482511 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.667462:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832482511 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.667477:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482518 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.667483:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.667489:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.667635:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b83248251f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.667644:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b83248251f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.667651:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b83248251f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787823625.667660:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787823625.667809:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832482511 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.667818:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832482511 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.667824:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832482511 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.667838:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eea600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823625.667842:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832482511 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.667849:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832482511 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.667861:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e7917859e00) 00010000:00010000:1.0:1787823625.667865:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823625.667869:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832482511 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.667876:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea600/0x5d1142b832482511 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.667890:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.667896:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482518 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.667901:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482518 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.667906:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eebc00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823625.667908:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482518 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.667914:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482518 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.667934:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e7917859f00) 00010000:00010000:1.0:1787823625.667936:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787823625.667939:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482518 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.667945:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482518 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.667984:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b83248250a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a05 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.667998:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b83248251f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a05 expref: 54 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.668006:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e791767be00) 00010000:00010000:1.0:1787823625.668008:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787823625.668010:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7920eeac00, rc 0) 00000100:00100000:1.0:1787823625.668078:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79351692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+54:11586:x1874668629875840:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 791us (993us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1787823625.668085:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 205 00000100:00100000:2.0:1787823625.672532:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823625.672645:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629875968 00000100:00100000:0.0:1787823625.672655:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629875968 00000100:00100000:0.0:1787823625.672727:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 206 00000100:00100000:0.0:1787823625.672737:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79360b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+54:11586:x1874668629875968:12345-192.168.202.35@tcp:54:lfs.0 00010000:00010000:0.0:1787823625.672848:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b83248252d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.672865:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b83248252d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.672876:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b83248252d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.672921:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b83248252d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.672928:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b83248252d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.672935:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b83248252d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.672941:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40e000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823625.672946:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b83248252d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.672952:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b83248252d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.672964:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e791767be00) 00010000:00010000:0.0:1787823625.672967:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787823625.672972:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b83248252d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.672979:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b83248252d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823625.673063:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79360b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+54:11586:x1874668629875968:12345-192.168.202.35@tcp:54:lfs.0 Request processed in 327us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823625.673072:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 206 00000100:00100000:3.0:1787823625.681122:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823625.681237:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629876224 00000100:00100000:1.0:1787823625.681247:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629876224 00000100:00100000:1.0:1787823625.681316:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 58 00000100:00100000:1.0:1787823625.681326:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+54:11586:x1874668629876224:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:1.0:1787823625.681589:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+55:11586:x1874668629876224:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 263us (476us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1787823625.681597:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 58 00000100:00100000:3.0:1787823625.836305:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823625.845516:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629876480 00000100:00100000:1.0:1787823625.845531:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629876480 00000100:00100000:1.0:1787823625.845629:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 207 00000100:00100000:1.0:1787823625.845639:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+55:11596:x1874668629876480:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:1.0:1787823625.845661:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823625.845664:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787823625.846512:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f000/0x5d1142b8324824af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449e9 expref: 55 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823625.847141:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e7917859e00) 00010000:00010000:1.0:1787823625.847148:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787823625.851192:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832482534 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44a0c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.852164:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b83248253b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.852181:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b83248253b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.852193:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b83248253b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787823625.852205:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787823625.853035:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832482534 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a0c expref: 57 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.853076:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b83248253b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a0c expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.853086:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e791767be00) 00010000:00010000:2.0:1787823625.853089:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787823625.853094:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d3800, rc 0) 00000100:00100000:2.0:1787823625.853234:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+56:11596:x1874668629876480:12345-192.168.202.35@tcp:101:bash.0 Request processed in 7595us (16938us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1787823625.853244:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 207 00000100:00100000:2.0:1787823625.870328:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823625.870581:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629876736 00000100:00100000:0.0:1787823625.870590:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629876736 00000100:00100000:0.0:1787823625.870648:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 208 00000100:00100000:0.0:1787823625.870668:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939df8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+56:11596:x1874668629876736:12345-192.168.202.35@tcp:36:bash.0 00010000:00010000:0.0:1787823625.870738:0:7893:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787823625.870792:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b83248253b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a0c expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.870816:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b83248251f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a05 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.870827:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e791767be00) 00010000:00010000:0.0:1787823625.870832:0:7893:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787823625.871048:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832482549 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.871061:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832482549 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.871070:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832482549 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787823625.871120:0:7893:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:0.0:1787823625.871142:0:7893:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000161bcead reply state 000000007dd1e059 transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832482549 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823625.871151:0:7893:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787823625.871248:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939df8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+57:11596:x1874668629876736:12345-192.168.202.35@tcp:36:bash.0 Request processed in 581us (930us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1787823625.871271:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 208 00000020:00080000:0.0:1787823625.871277:0:7893:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787823625.875074:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832482549 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.875092:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832482549 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.875100:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832482549 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.875106:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40e000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823625.875111:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832482549 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.875119:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832482549 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.875136:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e791767be00) 00010000:00010000:2.0:1787823625.875139:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823625.875160:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832482549 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823625.875167:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e000/0x5d1142b832482549 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823625.894928:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823625.895166:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629876864 00000100:00100000:0.0:1787823625.895178:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629876864 00000100:00100000:0.0:1787823625.895250:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 209 00000100:00100000:0.0:1787823625.895259:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ad50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+56:11596:x1874668629876864:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:0.0:1787823625.895297:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823625.895318:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832482550 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44a13 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.895411:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482557 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.895426:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482557 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.895437:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482557 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787823625.895465:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787823625.895469:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787823625.895486:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482557 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.895511:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832482550 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a13 expref: 58 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.895527:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482557 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a13 expref: 57 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823625.895548:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e791767be00) 00010000:00010000:0.0:1787823625.895551:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787823625.895555:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40ec00, rc 0) 00000100:00100000:0.0:1787823625.895619:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ad50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+57:11596:x1874668629876864:12345-192.168.202.35@tcp:101:bash.0 Request processed in 360us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823625.895632:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 209 00000100:00100000:2.0:1787823625.907086:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823625.907180:0:12014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629877120 00000100:00100000:1.0:1787823625.907191:0:12014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629877120 00000100:00100000:1.0:1787823625.907249:0:12014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 59 00000100:00100000:1.0:1787823625.907260:0:12014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ac86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:353832f0-fe7b-4d99-975c-a8041babed42+57:11596:x1874668629877120:12345-192.168.202.35@tcp:35:bash.0 00000100:00100000:1.0:1787823625.909067:0:12014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ac86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:353832f0-fe7b-4d99-975c-a8041babed42+58:11596:x1874668629877120:12345-192.168.202.35@tcp:35:bash.0 Request processed in 1799us (1982us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1787823625.909081:0:12014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 59 00000100:00100000:2.0:1787823625.937906:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823625.937957:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823625.937996:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823625.938036:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823625.938936:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629877376 00000100:00100000:0.0:1787823625.938948:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629877376 00000100:00100000:0.0:1787823625.939008:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629877504 00000100:00100000:0.0:1787823625.939011:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629877504 00000100:00100000:0.0:1787823625.939048:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 93 00000100:00100000:0.0:1787823625.939059:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+7:2352:x1874668629877376:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787823625.939145:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+7:2352:x1874668629877376:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 88us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823625.939154:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 93 00000100:00100000:0.0:1787823625.939173:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 94 00000100:00100000:0.0:1787823625.939180:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79049c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+9:2352:x1874668629877504:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787823625.939207:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79049c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+9:2352:x1874668629877504:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 28us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823625.939214:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 94 00000100:00080000:0.0:1787823625.939693:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787823625.939808:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629877632 00000100:00100000:3.0:1787823625.939814:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629877632 00000100:00100000:3.0:1787823625.939870:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 156 00000100:00100000:3.0:1787823625.939880:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2352:x1874668629877632:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787823625.939942:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2352:x1874668629877632:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 64us (1984us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823625.939948:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 156 00000100:00100000:1.0:1787823625.940228:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629877248 00000100:00100000:1.0:1787823625.940234:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629877248 00000100:00100000:1.0:1787823625.940288:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 298 00000100:00100000:1.0:1787823625.940297:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+13:2352:x1874668629877248:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787823625.940347:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+13:2352:x1874668629877248:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 51us (2349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823625.940354:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 298 00000100:00080000:0.0:1787823625.941798:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787823626.080815:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823626.081015:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629877760 00000100:00100000:0.0:1787823626.081024:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629877760 00000100:00100000:0.0:1787823626.081107:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 210 00000100:00100000:0.0:1787823626.081118:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+58:11602:x1874668629877760:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787823626.081143:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823626.081163:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b83248255e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44a1a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.081234:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832482565 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.081652:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832482565 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.081664:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832482565 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787823626.081726:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787823626.081730:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787823626.081755:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832482565 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.081817:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b83248255e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a1a expref: 60 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.081838:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832482565 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a1a expref: 59 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.081846:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e7917859e00) 00010000:00010000:0.0:1787823626.081849:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787823626.082002:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40fa00, rc 0) 00000100:00100000:0.0:1787823626.082069:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+59:11602:x1874668629877760:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 953us (1309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823626.082077:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 210 00000100:00080000:2.0:1787823626.082702:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787823626.105101:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823626.105321:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629877888 00000100:00100000:3.0:1787823626.105342:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629877888 00000100:00100000:3.0:1787823626.105397:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 211 00000100:00100000:3.0:1787823626.105407:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+59:11602:x1874668629877888:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:3.0:1787823626.105427:0:7893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823626.105447:0:7893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b83248256c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44a21 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.105513:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482573 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.105528:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482573 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.105565:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482573 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.105581:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d200/0x5d1142b83248257a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.105589:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d200/0x5d1142b83248257a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.105596:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d200/0x5d1142b83248257a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.105707:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c000/0x5d1142b832482581 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.105721:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c000/0x5d1142b832482581 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.105729:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c000/0x5d1142b832482581 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787823626.105806:0:7893:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787823626.105810:0:7893:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787823626.105829:0:7893:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c000/0x5d1142b832482581 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.105841:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c000/0x5d1142b832482581 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.105849:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482573 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.105869:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482573 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.105876:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482573 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.105883:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26de00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823626.105887:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482573 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.105894:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482573 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.106337:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e7917859e00) 00010000:00010000:3.0:1787823626.106342:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787823626.106356:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482573 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.106364:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482573 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.106384:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d200/0x5d1142b83248257a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.106392:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d200/0x5d1142b83248257a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.106399:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d200/0x5d1142b83248257a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.106404:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26d200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823626.106408:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d200/0x5d1142b83248257a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.106413:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d200/0x5d1142b83248257a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.106423:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e79087c9300) 00010000:00010000:3.0:1787823626.106425:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787823626.106428:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d200/0x5d1142b83248257a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.106435:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d200/0x5d1142b83248257a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.106474:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b83248256c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a21 expref: 61 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.106504:0:7893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c000/0x5d1142b832482581 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a21 expref: 60 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.106513:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e791767be00) 00010000:00010000:3.0:1787823626.106516:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787823626.106518:0:7893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a26c000, rc 0) 00000100:00100000:3.0:1787823626.106620:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+60:11602:x1874668629877888:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 1213us (1528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823626.106629:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 211 00000100:00100000:3.0:1787823626.116107:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823626.116727:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823626.117165:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629878016 00000100:00100000:0.0:1787823626.117176:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629878016 00000100:00100000:0.0:1787823626.117241:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 16 00000100:00100000:0.0:1787823626.117251:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:353832f0-fe7b-4d99-975c-a8041babed42+60:2353:x1874668629878016:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787823626.117408:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787823626.117449:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c000/0x5d1142b832482581 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a21 expref: 60 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.117468:0:7631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e791767be00) 00010000:00010000:0.0:1787823626.117473:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787823626.117611:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629878272 00000100:00100000:2.0:1787823626.117616:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629878272 00000100:00100000:2.0:1787823626.117668:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 212 00000100:00100000:2.0:1787823626.117684:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+60:11602:x1874668629878272:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:2.0:1787823626.117700:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823626.117716:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482588 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44a28 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.117845:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b83248258f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.117871:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482557 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a13 expref: 61 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.117881:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b83248258f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823626.118225:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:353832f0-fe7b-4d99-975c-a8041babed42+61:2353:x1874668629878016:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 974us (2127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823626.118234:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 16 00010000:00010000:2.0:1787823626.118282:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482557 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a13 expref: 61 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.118295:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482557 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a13 expref: 61 pid: 5839 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823626.118308:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a2ee580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1874668651885952:192.168.202.35@tcp:104: 00000100:00100000:2.0:1787823626.118386:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e780118e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787823626.134926:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823626.136146:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629878400 00000100:00100000:2.0:1787823626.136161:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629878400 00010000:00010000:2.0:1787823626.136204:0:7631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482557 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a13 expref: 61 pid: 5839 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823626.136259:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 77 00000100:00100000:2.0:1787823626.136270:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:353832f0-fe7b-4d99-975c-a8041babed42+61:2352:x1874668629878400:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787823626.136290:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787823626.136297:0:7631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482557 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a13 expref: 61 pid: 5839 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.136310:0:7631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482557 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a13 expref: 61 pid: 5839 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.136346:0:7631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e791767be00) 00010000:00010000:2.0:1787823626.136353:0:7631:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b83248258f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.136384:0:7631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b83248258f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.136394:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b83248258f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.136414:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787823626.136482:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:353832f0-fe7b-4d99-975c-a8041babed42+61:2352:x1874668629878400:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 212us (1576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823626.136490:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 77 00010000:00010000:1.0:1787823626.138095:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482557 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a13 expref: 60 pid: 5839 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823626.138117:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a2ee580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1874668651885952:192.168.202.35@tcp:104: 00010000:00010000:1.0:1787823626.138139:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b83248258f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823626.138149:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b83248258f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823626.138154:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b83248258f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787823626.138173:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787823626.138575:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482588 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a28 expref: 61 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823626.138592:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b83248258f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a28 expref: 60 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823626.138601:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e791767be00) 00010000:00010000:1.0:1787823626.138604:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787823626.138607:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d2a00, rc 0) 00000100:00100000:2.0:1787823626.141649:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+60:11602:x1874668629878272:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 23962us (24963us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1787823626.141662:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 212 00000100:00100000:1.0:1787823626.158890:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823626.159075:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629878656 00000100:00100000:3.0:1787823626.159085:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629878656 00000100:00100000:3.0:1787823626.159158:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 17 00000100:00100000:3.0:1787823626.159169:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fd6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:353832f0-fe7b-4d99-975c-a8041babed42+60:11602:x1874668629878656:12345-192.168.202.35@tcp:103:lfs.0 00010000:00010000:3.0:1787823626.159187:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787823626.159216:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b8324824ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449fe expref: 60 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.159237:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e791767be00) 00010000:00010000:3.0:1787823626.159243:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787823626.161112:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fd6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:353832f0-fe7b-4d99-975c-a8041babed42+59:11602:x1874668629878656:12345-192.168.202.35@tcp:103:lfs.0 Request processed in 1930us (2217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823626.161130:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 17 00000100:00100000:1.0:1787823626.166614:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823626.166659:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629878784 00000100:00100000:2.0:1787823626.166671:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629878784 00000100:00100000:2.0:1787823626.166738:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 213 00000100:00100000:2.0:1787823626.166750:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+59:11602:x1874668629878784:12345-192.168.202.35@tcp:58:lfs.0 00010000:00010000:2.0:1787823626.167085:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b83248259d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.167106:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b83248259d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.167120:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b83248259d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787823626.167438:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1787823626.167586:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+59:11602:x1874668629878784:12345-192.168.202.35@tcp:58:lfs.0 Request processed in 835us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823626.167607:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 213 00000100:00100000:2.0:1787823626.171004:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823626.171106:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629878912 00000100:00100000:3.0:1787823626.171132:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629878912 00000100:00100000:3.0:1787823626.171197:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 214 00000100:00100000:3.0:1787823626.171207:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+59:11602:x1874668629878912:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:3.0:1787823626.171229:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823626.171249:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b8324825a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44a2f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.171321:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b83248259d lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.171331:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b8324825a4 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a2f expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.171351:0:5838:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b83248259d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.171365:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b8324825a4 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a2f expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.171378:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e791767be00) 00010000:00010000:3.0:1787823626.171382:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787823626.171386:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b8324825a4 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a2f expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.171394:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a26d600, rc 0) 00000100:00100000:3.0:1787823626.171573:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+60:11602:x1874668629878912:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 367us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823626.171580:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 214 00000040:00080000:0.0:1787823626.283566:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787823626.283577:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787823626.283653:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1787823626.283661:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787823626.283848:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793516b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1874668651886080:192.168.202.35@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787823626.283962:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7904707d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787823626.291025:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823626.291147:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629879040 00000100:00100000:3.0:1787823626.291156:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629879040 00000100:00100000:3.0:1787823626.291217:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 215 00000100:00100000:3.0:1787823626.291227:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+61:11603:x1874668629879040:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787823626.291271:0:7893:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787823626.291371:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+61:11603:x1874668629879040:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 Request processed in 145us (1621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823626.291379:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 215 00000100:00100000:1.0:1787823626.295561:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823626.295713:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793516b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1874668651886080:192.168.202.35@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787823626.295752:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629879168 00000100:00100000:2.0:1787823626.295970:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629879168 00000100:00100000:2.0:1787823626.296069:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 216 00000100:00100000:2.0:1787823626.296081:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+60:11603:x1874668629879168:12345-192.168.202.35@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787823626.296170:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324825ab lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.296188:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324825ab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.296199:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324825ab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.296214:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b8324825b2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.296221:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b8324825b2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.296228:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b8324825b2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.296263:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324825b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.296272:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324825b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.296299:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324825b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787823626.296335:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787823626.296340:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787823626.296353:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324825b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.296364:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324825ab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.296370:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324825ab lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.296377:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324825ab lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.296383:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823626.296387:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324825ab lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.296395:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324825ab lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.296408:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e7917859800) 00010000:00010000:2.0:1787823626.296411:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823626.296416:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324825ab lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.296422:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324825ab lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.296447:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b8324825b2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.296453:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b8324825b2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.296460:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b8324825b2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.296465:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d2c00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823626.296468:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b8324825b2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.296591:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b8324825b2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.296603:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8e79228da600) 00010000:00010000:2.0:1787823626.296605:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823626.296608:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b8324825b2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.296614:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b8324825b2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.296627:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324825b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.296633:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324825b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.296638:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324825b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.296648:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823626.296650:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324825b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.296656:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324825b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.296663:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e791767be00) 00010000:00010000:2.0:1787823626.296665:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823626.296668:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324825b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.296967:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324825b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823626.297189:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+60:11603:x1874668629879168:12345-192.168.202.35@tcp:34:lhsmtool_posix.0 Request processed in 1106us (1710us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823626.297199:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 216 00000100:00100000:1.0:1787823626.300707:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823626.301061:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629879424 00000100:00100000:3.0:1787823626.301074:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629879424 00000100:00100000:3.0:1787823626.301146:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 217 00000100:00100000:3.0:1787823626.301157:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+60:11603:x1874668629879424:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787823626.301182:0:7893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823626.301205:0:7893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d200/0x5d1142b8324825c0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44a36 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.301384:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b8324825c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.301402:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b8324825c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.301417:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b8324825c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787823626.301432:0:7893:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787823626.301633:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b8324825c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.301658:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b8324825c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.301665:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b8324825c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.301962:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26de00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823626.301967:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b8324825c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.301976:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b8324825c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.301991:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e791767be00) 00010000:00010000:3.0:1787823626.301994:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787823626.301998:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b8324825c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.302005:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b8324825c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.302050:0:7893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d200/0x5d1142b8324825c0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a36 expref: 62 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.302062:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e7917859800) 00010000:00010000:3.0:1787823626.302064:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787823626.302068:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d200/0x5d1142b8324825c0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a36 expref: 62 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.302078:0:7893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a26d200, rc 0) 00000100:00100000:3.0:1787823626.302153:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+61:11603:x1874668629879424:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 997us (1459us total) trans 4294967504 rc 301/301 00000100:00100000:3.0:1787823626.302161:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 217 00000100:00100000:1.0:1787823626.307232:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823626.307423:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629879552 00000100:00100000:3.0:1787823626.307436:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629879552 00000100:00100000:3.0:1787823626.307648:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 218 00000100:00100000:3.0:1787823626.307662:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fd4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+61:11603:x1874668629879552:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787823626.307714:0:5838:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787823626.308038:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fd4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+61:11603:x1874668629879552:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 Request processed in 379us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823626.308048:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 218 00000100:00100000:1.0:1787823626.313634:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823626.313705:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629879808 00000100:00100000:2.0:1787823626.313718:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629879808 00000100:00100000:2.0:1787823626.313802:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 219 00000100:00100000:2.0:1787823626.313813:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926245a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+61:11603:x1874668629879808:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787823626.313836:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823626.313839:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787823626.313870:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fa00/0x5d1142b832482565 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a1a expref: 61 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.313892:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e7917859e00) 00010000:00010000:2.0:1787823626.313905:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787823626.313931:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324825d5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44a3d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787823626.314387:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1787823626.314615:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b8324825dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.314636:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b8324825dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.314648:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b8324825dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.314701:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324825d5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a3d expref: 63 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.314718:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b8324825dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a3d expref: 62 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.314726:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e79228da600) 00010000:00010000:2.0:1787823626.314730:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787823626.314732:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d2c00, rc 0) 00000100:00100000:2.0:1787823626.314851:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926245a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+62:11603:x1874668629879808:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 1039us (1227us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1787823626.314858:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 219 00000100:00100000:1.0:1787823626.318070:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823626.318120:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629880064 00000100:00100000:2.0:1787823626.318131:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629880064 00000100:00100000:2.0:1787823626.318195:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 220 00000100:00100000:2.0:1787823626.318206:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+62:11603:x1874668629880064:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787823626.318291:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787823626.318321:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b8324825dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a3d expref: 62 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.318341:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e79228da600) 00010000:00010000:2.0:1787823626.318352:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787823626.318376:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324825ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.318391:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324825ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.318402:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324825ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.318441:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b8324825f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x189d4fca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.318449:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b8324825f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x189d4fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.318456:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b8324825f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x189d4fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.318550:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324825ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.318558:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324825ea lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.318564:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324825ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.318578:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823626.318583:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324825ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.318592:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324825ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.318602:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e7917859e00) 00010000:00010000:2.0:1787823626.318605:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823626.318610:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324825ea lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.318617:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b8324825ea lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.318627:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b8324825f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x189d4fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.318633:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b8324825f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x189d4fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.318640:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b8324825f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x189d4fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.318645:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d2800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823626.318648:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b8324825f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x189d4fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.318653:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b8324825f1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x189d4fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.318670:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x189d4fca (ffff8e79228daa00) 00010000:00010000:2.0:1787823626.318672:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823626.318675:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b8324825f1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x189d4fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.318682:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b8324825f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x189d4fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823626.318803:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+61:11603:x1874668629880064:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 Request processed in 598us (740us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787823626.318811:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 220 00000100:00100000:1.0:1787823626.321540:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823626.321630:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629880192 00000100:00100000:3.0:1787823626.321642:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629880192 00000100:00100000:3.0:1787823626.321725:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 221 00000100:00100000:3.0:1787823626.321738:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+61:11603:x1874668629880192:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787823626.321790:0:7893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823626.322178:0:7893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d200/0x5d1142b8324825f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44a44 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.322223:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b8324825ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.322238:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b8324825ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.322250:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b8324825ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.322440:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d200/0x5d1142b8324825f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a44 expref: 63 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.322461:0:7893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b8324825ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a44 expref: 62 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.322471:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e79087c9300) 00010000:00010000:3.0:1787823626.322474:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787823626.322478:0:7893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a26de00, rc 0) 00000100:00100000:3.0:1787823626.322565:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+62:11603:x1874668629880192:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 828us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823626.322572:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 221 00000100:00100000:1.0:1787823626.327650:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823626.328040:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629880448 00000100:00100000:3.0:1787823626.328050:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629880448 00000100:00100000:3.0:1787823626.328110:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 222 00000100:00100000:3.0:1787823626.328120:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+62:11603:x1874668629880448:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787823626.328207:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832482606 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.328227:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832482606 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.328242:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832482606 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787823626.328519:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:3.0:1787823626.328543:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 367182783596ns, next at 368182767555ns, rc = 0 00000004:00010000:3.0:1787823626.328660:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008d165dbe reply state 00000000ddcf9e70 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832482606 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823626.329647:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787823626.329826:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+64:11603:x1874668629880448:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 Request processed in 1701us (2182us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1787823626.329835:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 222 00000100:00100000:1.0:1787823626.336494:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823626.337360:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629880576 00000100:00100000:3.0:1787823626.337373:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629880576 00000100:00100000:3.0:1787823626.337457:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 223 00000100:00100000:3.0:1787823626.337468:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+64:11603:x1874668629880576:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787823626.337494:0:7893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823626.337515:0:7893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d200/0x5d1142b83248260d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44a4b expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.337599:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d200/0x5d1142b83248260d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a4b expref: 65 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.337615:0:7893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d200/0x5d1142b83248260d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a4b expref: 65 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.337638:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e79087c9300) 00010000:00010000:3.0:1787823626.337641:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787823626.337645:0:7893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a26d200, rc 0) 00000100:00100000:3.0:1787823626.337728:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+65:11603:x1874668629880576:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 262us (1245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823626.337736:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 223 00000100:00100000:1.0:1787823626.340926:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823626.341301:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629880704 00000100:00100000:0.0:1787823626.341314:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629880704 00000100:00100000:0.0:1787823626.341387:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 62 00000100:00100000:0.0:1787823626.341399:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+9:2353:x1874668629880704:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787823626.342181:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+10:2353:x1874668629880704:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 Request processed in 781us (1267us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1787823626.342191:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 62 00010000:00010000:2.0:1787823626.343106:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832482606 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.343121:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832482606 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.343130:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832482606 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.343136:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26d000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823626.343142:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832482606 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.343150:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832482606 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.343169:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e79087c9300) 00010000:00010000:2.0:1787823626.343173:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787823626.343196:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832482606 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.343203:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832482606 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823626.356732:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823626.357016:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629880960 00000100:00100000:3.0:1787823626.357043:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629880960 00000100:00100000:3.0:1787823626.357112:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 60 00000100:00100000:3.0:1787823626.357125:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793516b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+64:11603:x1874668629880960:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787823626.357473:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793516b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+65:11603:x1874668629880960:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 Request processed in 350us (759us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1787823626.357482:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 60 00000100:00100000:3.0:1787823626.370312:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823626.370824:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629881216 00000100:00100000:2.0:1787823626.370835:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629881216 00000100:00100000:2.0:1787823626.370911:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 224 00000100:00100000:2.0:1787823626.370922:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f999680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+65:11603:x1874668629881216:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787823626.371037:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f999680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+65:11603:x1874668629881216:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 Request processed in 116us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823626.371045:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 224 00000100:00100000:2.0:1787823626.373992:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823626.374096:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629881344 00000100:00100000:3.0:1787823626.374105:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629881344 00000100:00100000:3.0:1787823626.374168:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 225 00000100:00100000:3.0:1787823626.374178:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a49e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+65:11603:x1874668629881344:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787823626.374198:0:7893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823626.374218:0:7893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482614 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44a52 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.374322:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26da00/0x5d1142b83248261b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.374337:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26da00/0x5d1142b83248261b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.374348:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26da00/0x5d1142b83248261b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787823626.374387:0:7893:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787823626.374406:0:7893:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26da00/0x5d1142b83248261b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.374431:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482614 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a52 expref: 67 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.374458:0:7893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26da00/0x5d1142b83248261b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a52 expref: 66 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.374467:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e79087c9300) 00010000:00010000:3.0:1787823626.374469:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787823626.374473:0:7893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a26da00, rc 0) 00000100:00100000:3.0:1787823626.374554:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a49e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+66:11603:x1874668629881344:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 378us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823626.374562:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 225 00000100:00100000:0.0:1787823626.381296:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823626.381621:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629881472 00000100:00100000:2.0:1787823626.381633:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629881472 00000100:00100000:2.0:1787823626.381704:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 63 00000100:00100000:2.0:1787823626.381717:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7935168000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:353832f0-fe7b-4d99-975c-a8041babed42+10:2352:x1874668629881472:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787823626.381738:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823626.381794:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a2b66f8/0x5d1142b832482622 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44a59 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787823626.381823:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a90060a, blocks: 0x1 00010000:00010000:2.0:1787823626.381846:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=367s v=(0 0) 00010000:00010000:2.0:1787823626.381852:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823626.381863:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a2b66f8/0x5d1142b832482622 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a59 expref: 11 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.381910:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003a2b66f8/0x5d1142b832482622 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a59 expref: 11 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.381924:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d3400, rc 0) 00000100:00100000:2.0:1787823626.381995:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7935168000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:353832f0-fe7b-4d99-975c-a8041babed42+11:2352:x1874668629881472:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 281us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823626.382003:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 63 00000100:00100000:0.0:1787823626.385060:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823626.385207:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629881728 00000100:00100000:2.0:1787823626.385217:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629881728 00000100:00100000:2.0:1787823626.385285:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 226 00000100:00100000:2.0:1787823626.385297:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4c8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+66:11603:x1874668629881728:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787823626.385455:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4c8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+66:11603:x1874668629881728:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 Request processed in 160us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823626.385464:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 226 00000100:00100000:1.0:1787823626.400276:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823626.400380:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629881856 00000100:00100000:2.0:1787823626.400394:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629881856 00000100:00100000:2.0:1787823626.400466:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 64 00000100:00100000:2.0:1787823626.400478:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+11:11603:x1874668629881856:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787823626.400500:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823626.400520:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832482629 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44a60 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.400568:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003a2b66f8/0x5d1142b832482622 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a59 expref: 12 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.400598:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823626.400603:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823626.400609:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832482629 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a60 expref: 12 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.400643:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003a2b66f8/0x5d1142b832482622 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a59 expref: 12 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.400656:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003a2b66f8/0x5d1142b832482622 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a59 expref: 12 pid: 6688 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823626.400682:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a49c3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6686:1874668651886208:192.168.202.35@tcp:104: 00000100:00100000:2.0:1787823626.400819:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e780118e180 going to sleep for 11 seconds 00000100:00100000:2.0:1787823626.405840:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a49c3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6686:1874668651886208:192.168.202.35@tcp:104: 00010000:00010000:2.0:1787823626.405883:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832482629 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a60 expref: 12 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.405907:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d2c00, rc 0) 00000100:00100000:2.0:1787823626.405989:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+12:11603:x1874668629881856:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 5513us (5735us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823626.406000:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 64 00000100:00100000:0.0:1787823626.409638:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823626.409809:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629881984 00000100:00100000:2.0:1787823626.409819:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629881984 00010000:00010000:2.0:1787823626.409870:0:7631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003a2b66f8/0x5d1142b832482622 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a59 expref: 12 pid: 6688 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823626.409925:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 78 00000100:00100000:2.0:1787823626.409936:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e93e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:353832f0-fe7b-4d99-975c-a8041babed42+12:2352:x1874668629881984:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787823626.409953:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787823626.409979:0:7631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003a2b66f8/0x5d1142b832482622 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a59 expref: 12 pid: 6688 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.409995:0:7631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003a2b66f8/0x5d1142b832482622 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a59 expref: 12 pid: 6688 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.410022:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a2b66f8/0x5d1142b832482622 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a59 expref: 12 pid: 6688 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.410040:0:7631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823626.410046:0:7631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823626.410054:0:7631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832482629 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a60 expref: 11 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.410065:0:7631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832482629 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a60 expref: 11 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.410104:0:7631:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832482629 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a60 expref: 11 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823626.410119:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a49c3c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7631:1874668651886336:192.168.202.35@tcp:105: 00000100:00100000:2.0:1787823626.410208:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e780118e180 going to sleep for 11 seconds 00000100:00100000:2.0:1787823626.414641:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a49c3c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7631:1874668651886336:192.168.202.35@tcp:105: 00010000:00010000:2.0:1787823626.414689:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787823626.414743:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e93e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:353832f0-fe7b-4d99-975c-a8041babed42+11:2352:x1874668629881984:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 4809us (5118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823626.414755:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 78 00000100:00100000:0.0:1787823626.419071:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823626.419173:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629882112 00000100:00100000:1.0:1787823626.419183:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629882112 00002000:00100000:1.0:1787823626.419237:0:6692:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8e792e93ed00 x1874668629882112/t0(0) o4->353832f0-fe7b-4d99-975c-a8041babed42@192.168.202.35@tcp:247/0 lens 504/0 e 0 to 0 dl 1787823637 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787823626.419248:0:6692:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8e792e93ed00 with x1874668629882112 ext(0->12) 00002000:00010000:1.0:1787823626.419254:0:6692:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e792e93ed00 00000100:00100000:1.0:1787823626.419288:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 6 00000100:00100000:1.0:1787823626.419299:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e93ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:353832f0-fe7b-4d99-975c-a8041babed42+11:2353:x1874668629882112:12345-192.168.202.35@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787823626.420302:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e93ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:353832f0-fe7b-4d99-975c-a8041babed42+13:2353:x1874668629882112:12345-192.168.202.35@tcp:4:lhsmtool_posix.0 Request processed in 996us (1233us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1787823626.420314:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 6 00002000:00100000:1.0:1787823626.420324:0:6692:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8e792e93ed00 x1874668629882112/t4294967320(0) o4->353832f0-fe7b-4d99-975c-a8041babed42@192.168.202.35@tcp:247/0 lens 504/448 e 0 to 0 dl 1787823637 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787823626.420333:0:6692:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8e792e93ed00 with x1874668629882112 ext(0->12) 00002000:00010000:1.0:1787823626.420338:0:6692:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e792e93ed00 00000100:00100000:0.0:1787823626.422707:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823626.422893:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629882240 00000100:00100000:3.0:1787823626.422902:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629882240 00000100:00100000:3.0:1787823626.422962:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 227 00000100:00100000:3.0:1787823626.422972:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e93de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+66:11603:x1874668629882240:12345-192.168.202.35@tcp:44:lhsmtool_posix.0 00010000:00010000:3.0:1787823626.474430:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787823626.480132:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967501 is committed 00000020:00080000:2.0:1787823626.480181:0:5860:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e7903ca70c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1787823626.480187:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e79358d4300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e7903ca7180 00000020:00080000:2.0:1787823626.480191:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e79358d4900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e793a62d000 00000001:00080000:2.0:1787823626.480225:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967503 is committed 00000004:00080000:2.0:1787823626.480244:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1787823626.480273:0:5860:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e790bdbe6c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1787823626.480276:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e792e811c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e790bdbe900 00000020:00080000:2.0:1787823626.480279:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e79204dd400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e7907e34400 00000020:00080000:2.0:1787823626.480299:0:5860:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:2.0:1787823626.480307:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000001:00080000:2.0:1787823626.480553:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00080000:2.0:1787823626.480561:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:2.0:1787823626.480580:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000100:00100000:2.0:1787823626.480866:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a49c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651886464:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787823626.480992:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1787823626.482606:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1787823626.482987:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1787823626.483015:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651886464 00000100:00100000:0.0:1787823626.483028:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651886464 00000100:00100000:0.0:1787823626.483570:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787823626.483587:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a49c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1874668651886464:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787823626.483626:0:6687:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:0.0:1787823626.483684:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a900609, atime: 0x6a90060a, ctime: 0x6a900609, blocks: 0x1 00010000:00010000:0.0:1787823626.483695:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000912e0012/0x5d1142b832482630 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.483719:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=367s v=(0 0) 00010000:00010000:0.0:1787823626.483725:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787823626.483897:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000912e0012/0x5d1142b832482630 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.483920:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000912e0012/0x5d1142b832482630 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.483932:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000912e0012/0x5d1142b832482630 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.483940:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000912e0012/0x5d1142b832482630 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.483961:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:2.0:1787823626.484808:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787823626.485659:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e93de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+20:11603:x1874668629882240:12345-192.168.202.35@tcp:44:lhsmtool_posix.0 Request processed in 62677us (62951us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823626.485684:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 227 00010000:00010000:3.0:1787823626.486630:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787823626.486647:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000912e0012/0x5d1142b832482630 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.486663:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40ea00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:3.0:1787823626.486674:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000912e0012/0x5d1142b832482630 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.486703:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000912e0012/0x5d1142b832482630 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.486732:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000912e0012/0x5d1142b832482630 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.486739:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000912e0012/0x5d1142b832482630 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.486783:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823626.486785:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823626.486787:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787823626.490234:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a49e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651886720:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787823626.490487:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a49f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651886592:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787823626.492907:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823626.494501:0:6686:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787823626.494523:0:6686:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1787823626.495892:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823626.496375:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787823626.496396:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651886720 00000100:00100000:1.0:1787823626.496409:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651886720 00000100:00100000:1.0:1787823626.496490:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787823626.496496:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629882368 00000100:00100000:1.0:1787823626.496499:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629882368 00000100:00100000:1.0:1787823626.496636:0:12475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787823626.496649:0:12475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec67c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1874668651886720:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787823626.496965:0:12475:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787823626.496970:0:12475:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787823626 00002000:00010000:1.0:1787823626.496972:0:12475:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787823626.496974:0:12475:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787823626 -> 1787823626 00002000:00010000:1.0:1787823626.496976:0:12475:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787823626.497074:0:12475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec67c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1874668651886720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 426us (4178us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1787823626.497083:0:12475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787823626.497511:0:12475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 67 00000100:00100000:1.0:1787823626.497522:0:12475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec65a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:353832f0-fe7b-4d99-975c-a8041babed42+13:2354:x1874668629882368:12345-192.168.202.35@tcp:16:lhsmtool_posix.0 00000100:00080000:2.0:1787823626.498270:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1787823626.498340:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e793a49e1c0/2, rc 0, transno 4294967321 00000100:00100000:2.0:1787823626.498350:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a49e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651886720:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787823626.498695:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a49c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1874668651886464:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15111us (17703us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787823626.498706:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:1.0:1787823626.499464:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e793a49c3c0/2, rc 0, transno 4294967310 00000100:00100000:1.0:1787823626.499475:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a49c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651886464:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787823626.506804:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823626.506876:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651886592 00000100:00100000:3.0:1787823626.506886:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651886592 00000100:00100000:3.0:1787823626.506949:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787823626.506958:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f998780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1874668651886592:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787823626.506996:0:6688:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:3.0:1787823626.507027:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b1de29d/0x5d1142b832482637 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.507055:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000b672e8a/0x5d1142b8324823f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449bf expref: 13 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.507082:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1787823626.507226:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787823626.507232:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b1de29d/0x5d1142b832482637 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.507286:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000b672e8a/0x5d1142b8324823f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449bf expref: 13 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.507303:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000b672e8a/0x5d1142b8324823f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449bf expref: 13 pid: 6688 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823626.507318:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793f99a1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6688:1874668651886848:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787823626.507500:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e791004ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1787823626.515199:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823626.515463:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629882496 00000100:00100000:0.0:1787823626.515473:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629882496 00010000:00010000:0.0:1787823626.515521:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000b672e8a/0x5d1142b8324823f2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449bf expref: 14 pid: 6688 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823626.515573:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 79 00000100:00100000:0.0:1787823626.515583:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79037f0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:353832f0-fe7b-4d99-975c-a8041babed42+14:2352:x1874668629882496:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787823626.515600:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787823626.515606:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000b672e8a/0x5d1142b8324823f2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449bf expref: 14 pid: 6688 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.515620:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000b672e8a/0x5d1142b8324823f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449bf expref: 14 pid: 6688 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.515650:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787823626.515657:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787823626.515663:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004b1de29d/0x5d1142b832482637 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.515684:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b1de29d/0x5d1142b832482637 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.515710:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787823626.515827:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79037f0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:353832f0-fe7b-4d99-975c-a8041babed42+14:2352:x1874668629882496:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 233us (1487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823626.515846:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 79 00010000:00010000:3.0:1787823626.516214:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b672e8a/0x5d1142b8324823f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449bf expref: 13 pid: 6688 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823626.516232:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793f99a1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6688:1874668651886848:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787823626.516264:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004b1de29d/0x5d1142b832482637 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.516277:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004b1de29d/0x5d1142b832482637 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.516285:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b1de29d/0x5d1142b832482637 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.516305:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b1de29d/0x5d1142b832482637 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.516313:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b1de29d/0x5d1142b832482637 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.516460:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787823626.518076:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f998780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3305:x1874668651886592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11111us (11309us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1787823626.518099:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:3.0:1787823626.518130:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787823626.518138:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b1de29d/0x5d1142b832482637 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.518150:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26ce00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:3.0:1787823626.518154:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b1de29d/0x5d1142b832482637 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.518164:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b1de29d/0x5d1142b832482637 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.518184:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b1de29d/0x5d1142b832482637 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.518191:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b1de29d/0x5d1142b832482637 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.518226:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823626.518229:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823626.518230:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787823626.523578:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e793a49f840/2, rc 0, transno 4294967322 00000100:00100000:1.0:1787823626.523595:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a49f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651886592:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1787823626.554078:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:3.0:1787823626.554109:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:3.0:1787823626.554116:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:3.0:1787823626.554121:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:1.0:1787823626.554361:0:12475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec65a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:353832f0-fe7b-4d99-975c-a8041babed42+7:2354:x1874668629882368:12345-192.168.202.35@tcp:16:lhsmtool_posix.0 Request processed in 56834us (58476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823626.554375:0:12475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 67 00000100:00100000:1.0:1787823626.561958:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823626.562118:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629882752 00000100:00100000:2.0:1787823626.562129:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629882752 00000100:00100000:2.0:1787823626.562195:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 228 00000100:00100000:2.0:1787823626.562208:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a03cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+20:11603:x1874668629882752:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787823626.562272:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787823626.562298:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26da00/0x5d1142b83248261b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a52 expref: 20 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.562324:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e79087c9300) 00010000:00010000:2.0:1787823626.562337:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787823626.562374:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b83248263e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.562388:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b83248263e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.562398:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b83248263e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787823626.562704:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002cafec7e reply state 00000000de3f78b9 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b83248263e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823626.562715:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787823626.562888:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a03cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+21:11603:x1874668629882752:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 Request processed in 682us (943us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1787823626.562915:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 228 00000100:00100000:1.0:1787823626.573219:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00010000:00010000:2.0:1787823626.573489:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b83248263e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.573505:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b83248263e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.573513:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b83248263e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.573520:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823626.573538:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b83248263e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.573547:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b83248263e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.573577:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e79087c9300) 00010000:00010000:2.0:1787823626.573581:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823626.573586:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b83248263e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.573593:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b83248263e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823626.574180:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629882880 00000100:00100000:3.0:1787823626.574194:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629882880 00000100:00100000:3.0:1787823626.574264:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 69 00000100:00100000:3.0:1787823626.574275:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a03ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+7:2353:x1874668629882880:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787823626.574517:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787823626.574522:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1787823626 -> 1787823626 00002000:00010000:3.0:1787823626.574525:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787823626 00002000:00010000:3.0:1787823626.574540:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787823626 -> 1787823626 00002000:00010000:3.0:1787823626.574543:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787823626.574636:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a03ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+8:2353:x1874668629882880:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 Request processed in 362us (1429us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1787823626.574644:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 69 00000100:00100000:2.0:1787823626.578812:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823626.578964:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629883136 00000100:00100000:1.0:1787823626.578991:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629883136 00000100:00100000:1.0:1787823626.579055:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 229 00000100:00100000:1.0:1787823626.579066:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec65680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+20:11603:x1874668629883136:12345-192.168.202.35@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787823626.579140:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482645 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823626.579161:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b8324825ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a44 expref: 20 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823626.579172:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482645 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823626.579208:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b8324825ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a44 expref: 20 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823626.579223:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b8324825ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a44 expref: 20 pid: 7893 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823626.579238:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a03f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1874668651886976:192.168.202.35@tcp:104: 00000100:00100000:1.0:1787823626.579352:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908c15a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787823626.588636:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823626.588797:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629883264 00000100:00100000:0.0:1787823626.588808:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629883264 00010000:00010000:0.0:1787823626.588867:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b8324825ff lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a44 expref: 21 pid: 7893 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823626.588953:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 80 00000100:00100000:0.0:1787823626.588964:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f99a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:353832f0-fe7b-4d99-975c-a8041babed42+21:2353:x1874668629883264:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787823626.588983:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787823626.588991:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b8324825ff lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a44 expref: 21 pid: 7893 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.589005:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b8324825ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a44 expref: 21 pid: 7893 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.589035:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e79087c9300) 00010000:00010000:0.0:1787823626.589041:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482645 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.589051:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482645 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.589059:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482645 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.589083:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787823626.589160:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f99a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:353832f0-fe7b-4d99-975c-a8041babed42+21:2353:x1874668629883264:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 196us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823626.589188:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 80 00010000:00010000:1.0:1787823626.591449:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b8324825ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a44 expref: 20 pid: 7893 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823626.591485:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a03f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1874668651886976:192.168.202.35@tcp:104: 00010000:00010000:1.0:1787823626.591511:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482645 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823626.591523:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482645 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823626.591573:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482645 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823626.591606:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482645 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823626.591614:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482645 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823626.591622:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482645 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823626.591628:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eebc00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1787823626.591633:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482645 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823626.591640:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482645 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823626.591657:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e79087c9300) 00010000:00010000:1.0:1787823626.591660:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787823626.591665:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482645 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823626.592223:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482645 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823626.592450:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec65680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+19:11603:x1874668629883136:12345-192.168.202.35@tcp:55:lhsmtool_posix.0 Request processed in 13382us (13648us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787823626.592462:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 229 00000100:00100000:3.0:1787823626.597129:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823626.597367:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629883392 00000100:00100000:1.0:1787823626.597379:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629883392 00000100:00100000:1.0:1787823626.597444:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 70 00000100:00100000:1.0:1787823626.597454:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f99a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:353832f0-fe7b-4d99-975c-a8041babed42+8:2354:x1874668629883392:12345-192.168.202.35@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787823626.597512:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b38f53ac/0x5d1142b83248264c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823626.597548:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832482629 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a60 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823626.597566:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787823626.597572:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787823626.597577:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b38f53ac/0x5d1142b83248264c lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823626.597614:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832482629 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a60 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823626.597630:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832482629 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a60 expref: 8 pid: 6686 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823626.597645:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a03f0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6688:1874668651887104:192.168.202.35@tcp:104: 00000100:00100000:1.0:1787823626.597736:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908c15a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787823626.602928:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823626.603097:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a03f0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6688:1874668651887104:192.168.202.35@tcp:104: 00010000:00010000:2.0:1787823626.603129:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b38f53ac/0x5d1142b83248264c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823626.603497:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629883520 00000100:00100000:0.0:1787823626.603505:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629883520 00010000:00010000:0.0:1787823626.603561:0:7631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832482629 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a60 expref: 9 pid: 6686 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823626.603604:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 81 00000100:00100000:0.0:1787823626.603615:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a03e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:353832f0-fe7b-4d99-975c-a8041babed42+9:2353:x1874668629883520:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787823626.603629:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787823626.603658:0:7631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832482629 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a60 expref: 9 pid: 6686 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.603671:0:7631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832482629 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a60 expref: 9 pid: 6686 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.603696:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832482629 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a60 expref: 9 pid: 6686 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.603713:0:7631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787823626.603718:0:7631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787823626.603723:0:7631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b38f53ac/0x5d1142b83248264c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.603733:0:7631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b38f53ac/0x5d1142b83248264c lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.603811:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787823626.603881:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a03e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:353832f0-fe7b-4d99-975c-a8041babed42+8:2353:x1874668629883520:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 267us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823626.603889:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 81 00010000:00010000:0.0:1787823626.603914:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b38f53ac/0x5d1142b83248264c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.603922:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b38f53ac/0x5d1142b83248264c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.603945:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b38f53ac/0x5d1142b83248264c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.603953:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b38f53ac/0x5d1142b83248264c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.603961:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b38f53ac/0x5d1142b83248264c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.603969:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eeac00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:0.0:1787823626.603973:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b38f53ac/0x5d1142b83248264c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.603982:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b38f53ac/0x5d1142b83248264c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.604007:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b38f53ac/0x5d1142b83248264c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.604015:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b38f53ac/0x5d1142b83248264c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823626.604068:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f99a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:353832f0-fe7b-4d99-975c-a8041babed42+7:2354:x1874668629883392:12345-192.168.202.35@tcp:1:lhsmtool_posix.0 Request processed in 6616us (6951us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823626.604076:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 70 00000100:00100000:3.0:1787823626.608424:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823626.608604:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629883776 00000100:00100000:2.0:1787823626.608619:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629883776 00000100:00100000:2.0:1787823626.608697:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 230 00000100:00100000:2.0:1787823626.608709:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+19:11603:x1874668629883776:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787823626.608844:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482653 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.608867:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482653 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.608879:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482653 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.609269:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b83248265a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.609283:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d200/0x5d1142b83248260d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a4b expref: 20 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.609292:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b83248265a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.609426:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d200/0x5d1142b83248260d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a4b expref: 20 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.609442:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d200/0x5d1142b83248260d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a4b expref: 20 pid: 7893 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823626.609478:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec64780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1874668651887232:192.168.202.35@tcp:104: 00000100:00100000:2.0:1787823626.609622:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e780118e240 going to sleep for 11 seconds 00000100:00100000:3.0:1787823626.620941:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823626.621219:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629883904 00000100:00100000:0.0:1787823626.621230:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629883904 00010000:00010000:0.0:1787823626.621285:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d200/0x5d1142b83248260d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a4b expref: 21 pid: 7893 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823626.621339:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 82 00000100:00100000:0.0:1787823626.621350:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f99bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:353832f0-fe7b-4d99-975c-a8041babed42+21:2352:x1874668629883904:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787823626.621367:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787823626.621375:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d200/0x5d1142b83248260d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a4b expref: 21 pid: 7893 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.621390:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d200/0x5d1142b83248260d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a4b expref: 21 pid: 7893 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.621419:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e79087c9300) 00010000:00010000:0.0:1787823626.621425:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b83248265a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.621450:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b83248265a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.621458:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b83248265a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.621479:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787823626.621551:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f99bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:353832f0-fe7b-4d99-975c-a8041babed42+21:2352:x1874668629883904:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 202us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823626.621569:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 82 00010000:00010000:2.0:1787823626.622230:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d200/0x5d1142b83248260d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a4b expref: 20 pid: 7893 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823626.622249:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec64780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1874668651887232:192.168.202.35@tcp:104: 00010000:00010000:2.0:1787823626.622276:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b83248265a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.622286:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b83248265a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.622292:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b83248265a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787823626.622502:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1787823626.623051:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1787823626.623101:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1787823626.623196:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec64780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5839:1874668651887360:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787823626.623262:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823626.623296:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908f8c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787823626.624186:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651887360 00000100:00100000:0.0:1787823626.624196:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651887360 00000100:00100000:0.0:1787823626.624265:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787823626.624275:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5839:x1874668651887360:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787823626.624390:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5839:x1874668651887360:12345-0@lo:1000:mdt00_001.0 Request processed in 117us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823626.624398:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787823626.624571:0:5839:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:3.0:1787823626.624577:0:5839:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:3.0:1787823626.624610:0:5839:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e793a49e1c0, transno 4294967321 00000100:00100000:3.0:1787823626.624630:0:5839:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8e793a49f840 x1874668651886592/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787823642 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823626.624643:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec64780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5839:1874668651887360:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1787823626.626321:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:3.0:1787823626.627108:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793f998000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5839:1874668651887488:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787823626.627173:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823626.627212:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e791004ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1787823626.628808:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651887488 00000100:00100000:0.0:1787823626.628823:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651887488 00000100:00100000:0.0:1787823626.628882:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787823626.628893:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f99a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5839:x1874668651887488:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787823626.629174:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f99a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5839:x1874668651887488:12345-0@lo:1000:mdt00_001.0 Request processed in 282us (2000us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1787823626.629182:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787823626.629351:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793f998000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5839:1874668651887488:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1787823626.629403:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b83248265a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.629414:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b83248265a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.629423:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b83248265a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.629429:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d2800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823626.629435:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b83248265a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.629443:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b83248265a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.629461:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e79087c9300) 00010000:00010000:3.0:1787823626.629465:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787823626.629470:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b83248265a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.629495:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b83248265a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.629547:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b83248259d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.629554:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b83248259d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.629560:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b83248259d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.629565:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823626.629569:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b83248259d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.629575:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b83248259d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.629584:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e791767be00) 00010000:00010000:3.0:1787823626.629586:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787823626.629594:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b8324825a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a2f expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.629606:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b8324825a4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a2f expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.629618:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b8324825a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a2f expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.629667:0:5839:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b8324825a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a2f expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823626.630226:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7939df8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1874668651887616:192.168.202.35@tcp:105: 00000100:00100000:3.0:1787823626.630308:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e791004ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1787823626.637413:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823626.637582:0:12014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629884032 00000100:00100000:1.0:1787823626.637592:0:12014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629884032 00000100:00100000:1.0:1787823626.637656:0:12014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 61 00000100:00100000:1.0:1787823626.637692:0:12014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e93e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:353832f0-fe7b-4d99-975c-a8041babed42+24:11602:x1874668629884032:12345-192.168.202.35@tcp:49:lfs.0 00000100:00100000:3.0:1787823626.638131:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7939df8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1874668651887616:192.168.202.35@tcp:105: 00010000:00010000:3.0:1787823626.638160:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b83248259d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.638171:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b83248259d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.638203:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482661 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.638219:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482661 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.638230:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482661 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.638240:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482661 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.638247:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482661 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.638254:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482661 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.638272:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26ce00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823626.638275:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482661 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.638282:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482661 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.638294:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e791767be00) 00010000:00010000:3.0:1787823626.638297:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787823626.638301:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482661 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.638306:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482661 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.638316:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482653 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.638322:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482653 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.638340:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482653 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.638344:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823626.638347:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482653 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.638353:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482653 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.638370:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e791767be00) 00010000:00010000:3.0:1787823626.638372:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787823626.638375:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482653 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823626.638381:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482653 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787823626.638691:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787823626.638696:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1787823626.638859:0:12014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e93e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:353832f0-fe7b-4d99-975c-a8041babed42+24:11602:x1874668629884032:12345-192.168.202.35@tcp:49:lfs.0 Request processed in 1169us (1455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823626.638868:0:12014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 61 00000040:00080000:3.0:1787823626.642194:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787823626.642221:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787823626.643228:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+23:11603:x1874668629883776:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 Request processed in 34509us (34805us total) trans 4294967513 rc 0/0 00000100:00100000:3.0:1787823626.643244:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 230 00000020:00080000:3.0:1787823626.643256:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1787823626.651912:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823626.652234:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629884288 00000100:00100000:3.0:1787823626.652245:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629884288 00000100:00100000:3.0:1787823626.652310:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 231 00000100:00100000:3.0:1787823626.652320:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a03cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+23:11602:x1874668629884288:12345-192.168.202.35@tcp:58:lfs.0 00000100:00100000:3.0:1787823626.656554:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823626.656735:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629884544 00000100:00100000:1.0:1787823626.656748:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629884544 00000100:00100000:1.0:1787823626.656868:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 62 00000100:00100000:1.0:1787823626.656882:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7925a4cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+24:11603:x1874668629884544:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 00000040:00080000:2.0:1787823626.661208:0:7893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1787823626.661647:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a03cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+25:11602:x1874668629884288:12345-192.168.202.35@tcp:58:lfs.0 Request processed in 9321us (9743us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823626.661661:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 231 00000004:00080000:1.0:1787823626.662002:0:5842:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787823626.662457:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:1.0:1787823626.662524:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832482668 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823626.662556:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832482668 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823626.663711:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832482668 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823626.663723:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832482668 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823626.663731:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832482668 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823626.663737:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832482668 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823626.663773:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787823626.664038:0:7629:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787823626.664046:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832482668 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.664062:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eeac00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:2.0:1787823626.664066:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832482668 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.664075:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832482668 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823626.665281:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7925a4cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+25:11603:x1874668629884544:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 Request processed in 8391us (8740us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1787823626.665296:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 62 00000020:00080000:1.0:1787823626.665303:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787823626.667129:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e7917859700) 00010000:00010000:2.0:1787823626.667138:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787823626.667147:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832482668 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.667157:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b832482668 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.667185:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823626.667187:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823626.667190:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823626.732302:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823626.732580:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629884672 00000100:00100000:2.0:1787823626.732590:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629884672 00000100:00100000:2.0:1787823626.732646:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 232 00000100:00100000:2.0:1787823626.732655:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939df8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+25:11605:x1874668629884672:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:2.0:1787823626.732684:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823626.732711:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b83248266f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44a67 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.732831:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482676 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.733104:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482676 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.733117:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482676 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.733134:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b83248267d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.733142:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b83248267d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.733149:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b83248267d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.736582:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482684 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.736607:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b83248258f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a28 expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.736618:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482684 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.736662:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b83248258f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a28 expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823626.736687:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b83248258f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a28 expref: 26 pid: 5839 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823626.736718:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec64780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1874668651887744:192.168.202.35@tcp:104: 00000100:00100000:2.0:1787823626.737093:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908f8cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787823626.737151:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792eb04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651887872:0@lo:400:kworker.0 00000100:00100000:2.0:1787823626.737198:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823626.737245:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787823626.737250:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792eb07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874668651888000:0@lo:400:kworker.0 00000100:00100000:2.0:1787823626.737279:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823626.737319:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787823626.737338:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874668651888128:0@lo:400:kworker.0 00000100:00100000:2.0:1787823626.737361:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823626.737387:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651888000 00000100:00100000:2.0:1787823626.737394:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651888000 00000100:00100000:2.0:1787823626.737430:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651888128 00000100:00100000:2.0:1787823626.737432:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651888128 00000100:00100000:2.0:1787823626.737453:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787823626.737461:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79360b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874668651888000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823626.737508:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79360b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874668651888000:12345-0@lo:400:kworker.0 Request processed in 48us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823626.737515:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787823626.737546:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787823626.737552:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874668651888128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823626.737579:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874668651888128:12345-0@lo:400:kworker.0 Request processed in 27us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823626.737584:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:2.0:1787823626.737608:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787823626.737636:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792eb07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874668651888000:0@lo:400:kworker.0 00000100:00100000:2.0:1787823626.737660:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874668651888128:0@lo:400:kworker.0 00000100:00100000:2.0:1787823626.737685:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874668651888256:0@lo:400:kworker.0 00000100:00100000:2.0:1787823626.737708:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823626.737732:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651888256 00000100:00100000:2.0:1787823626.737735:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651888256 00000100:00100000:2.0:1787823626.737783:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787823626.737790:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874668651888256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823626.737834:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874668651888256:12345-0@lo:400:kworker.0 Request processed in 45us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823626.737840:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:2.0:1787823626.738163:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787823626.738184:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874668651888256:0@lo:400:kworker.0 00000100:00100000:3.0:1787823626.741283:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823626.742313:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec64780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1874668651887744:192.168.202.35@tcp:104: 00010000:00010000:2.0:1787823626.742422:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482684 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823626.742788:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651887872 00000100:00100000:1.0:1787823626.742796:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651887872 00000100:00100000:1.0:1787823626.743076:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1787823626.743089:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3307:x1874668651887872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823626.743183:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3307:x1874668651887872:12345-0@lo:400:kworker.0 Request processed in 97us (5984us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823626.743191:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1787823626.743247:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792eb04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651887872:0@lo:400:kworker.0 00000100:00100000:2.0:1787823626.743694:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629884928 00000100:00100000:2.0:1787823626.743700:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629884928 00000100:00100000:2.0:1787823626.743743:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 63 00000100:00100000:2.0:1787823626.743752:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+27:5592:x1874668629884928:12345-192.168.202.35@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787823626.744439:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+28:5592:x1874668629884928:12345-192.168.202.35@tcp:35:ldlm_bl.0 Request processed in 686us (3166us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1787823626.744448:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 63 00000100:00100000:3.0:1787823626.751374:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823626.751693:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629885056 00000100:00100000:0.0:1787823626.751705:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629885056 00010000:00010000:0.0:1787823626.751802:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b83248258f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a28 expref: 28 pid: 5839 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823626.751858:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 83 00000100:00100000:0.0:1787823626.751869:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:353832f0-fe7b-4d99-975c-a8041babed42+28:2353:x1874668629885056:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787823626.751887:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787823626.751895:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b83248258f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a28 expref: 28 pid: 5839 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.751908:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b83248258f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a28 expref: 28 pid: 5839 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.751931:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b83248258f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a28 expref: 28 pid: 5839 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.751946:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e791767be00) 00010000:00010000:0.0:1787823626.751951:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482684 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.751959:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.751967:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482684 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.751995:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787823626.752017:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.752025:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787823626.752074:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787823626.752079:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787823626.752111:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.752124:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.752135:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482676 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.752142:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482676 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.752148:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482676 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.752154:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823626.752159:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482676 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.752167:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482676 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.752175:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e7917859e00) 00010000:00010000:0.0:1787823626.752178:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823626.752182:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482676 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.752188:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482676 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.752209:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b83248267d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.752215:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b83248267d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.752221:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b83248267d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.752226:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823626.752229:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b83248267d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.752235:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b83248267d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.752244:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e79228da400) 00010000:00010000:0.0:1787823626.752246:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823626.752249:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b83248267d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.752255:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b83248267d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.752287:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2200/0x5d1142b83248266f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a67 expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.752300:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482684 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a67 expref: 27 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823626.752318:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e791767be00) 00010000:00010000:0.0:1787823626.752320:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787823626.752323:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d3400, rc 0) 00000100:00100000:0.0:1787823626.753057:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939df8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+27:11605:x1874668629884672:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 20400us (20763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823626.753067:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 232 00000100:00100000:0.0:1787823626.758010:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:353832f0-fe7b-4d99-975c-a8041babed42+26:2353:x1874668629885056:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 6128us (6634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823626.758028:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 83 00000100:00100000:3.0:1787823627.246953:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787823627.246976:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651888384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787823627.247059:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823627.247128:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651888384 00000100:00100000:3.0:1787823627.247136:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651888384 00000100:00100000:3.0:1787823627.247180:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787823627.247189:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2b8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1874668651888384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787823627.247212:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1787823627.247493:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2b8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1874668651888384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 304us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823627.247500:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787823627.247567:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651888384:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787823627.501169:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787823627.696458:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787823627.696468:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787823627.696504:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787823627.696512:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787823627.697497:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792e93e580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1874668651888512:192.168.202.35@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787823627.697942:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7904707840 going to sleep for 11 seconds 00000100:00100000:0.0:1787823627.708368:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792e93e580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1874668651888512:192.168.202.35@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787823627.716461:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823627.716634:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629885184 00000100:00100000:2.0:1787823627.716644:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629885184 00000100:00100000:2.0:1787823627.716724:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 233 00000100:00100000:2.0:1787823627.716737:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e93e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+26:11616:x1874668629885184:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787823627.716821:0:7893:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787823627.716930:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e93e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+26:11616:x1874668629885184:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 Request processed in 196us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823627.716938:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 233 00000100:00100000:3.0:1787823627.725933:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823627.726027:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629885440 00000100:00100000:1.0:1787823627.726039:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629885440 00000100:00100000:1.0:1787823627.726098:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 234 00000100:00100000:1.0:1787823627.726109:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+26:11616:x1874668629885440:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787823627.726130:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823627.726150:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b83248268b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44a6e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823627.726251:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482692 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823627.726268:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482692 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823627.726280:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482692 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787823627.726305:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787823627.726435:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b83248268b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a6e expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823627.726452:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482692 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a6e expref: 28 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823627.726461:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e791767be00) 00010000:00010000:1.0:1787823627.726463:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787823627.726468:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7920eebc00, rc 0) 00000100:00100000:1.0:1787823627.726542:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+28:11616:x1874668629885440:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 435us (618us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1787823627.726550:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 234 00000100:00100000:1.0:1787823627.731782:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823627.731819:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823627.731908:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629885696 00000100:00100000:2.0:1787823627.731918:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629885696 00000100:00100000:2.0:1787823627.731974:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 235 00000100:00100000:2.0:1787823627.731985:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a03f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+28:11616:x1874668629885696:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787823627.732070:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324826a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823627.732089:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324826a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823627.732103:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324826a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823627.732321:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324826a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823627.732331:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324826a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823627.732339:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324826a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823627.732355:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823627.732361:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324826a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823627.732369:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324826a0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823627.732383:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e791767be00) 00010000:00010000:2.0:1787823627.732386:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787823627.732392:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324826a0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823627.732398:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b8324826a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823627.732568:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a03f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+29:11616:x1874668629885696:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 Request processed in 583us (816us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1787823627.732577:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 235 00000100:00100000:2.0:1787823627.732608:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629885824 00000100:00100000:2.0:1787823627.732612:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629885824 00000100:00100000:2.0:1787823627.732644:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 18 00000100:00100000:2.0:1787823627.732652:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e791ac86940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:353832f0-fe7b-4d99-975c-a8041babed42+29:2352:x1874668629885824:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787823627.732664:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787823627.732680:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b832482692 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a6e expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823627.732691:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e791767be00) 00010000:00010000:2.0:1787823627.732695:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787823627.732721:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e791ac86940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:353832f0-fe7b-4d99-975c-a8041babed42+28:2352:x1874668629885824:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 70us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823627.732729:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 18 00000040:00080000:2.0:1787823627.732882:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787823627.732887:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787823627.733376:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787823627.733385:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787823627.741072:0:12513:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787823627.741189:0:12513:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787823627.741238:0:12513:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787823627.741246:0:12513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787823627.743088:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823627.743562:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629886080 00000100:00100000:3.0:1787823627.743572:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629886080 00000100:00100000:3.0:1787823627.743637:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 64 00000100:00100000:3.0:1787823627.743648:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+28:11616:x1874668629886080:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787823627.744104:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+29:11616:x1874668629886080:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 Request processed in 456us (1035us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1787823627.744113:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 64 00000100:00100000:3.0:1787823628.008553:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823628.009041:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629886336 00000100:00100000:1.0:1787823628.009052:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629886336 00000100:00100000:1.0:1787823628.009327:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 236 00000100:00100000:1.0:1787823628.009340:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+29:11629:x1874668629886336:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:1.0:1787823628.009367:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823628.009388:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b8324826a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44a75 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823628.009500:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b8324826ae lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823628.009526:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b8324826ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823628.009551:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b8324826ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787823628.009562:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787823628.009706:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b8324826a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a75 expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823628.009727:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b8324826ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a75 expref: 31 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823628.009735:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e791767be00) 00010000:00010000:1.0:1787823628.009738:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787823628.009742:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7920eebc00, rc 0) 00000100:00100000:1.0:1787823628.009831:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+31:11629:x1874668629886336:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 494us (1288us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1787823628.009838:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 236 00000100:00080000:2.0:1787823628.010450:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787823628.014495:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823628.014590:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629886464 00000100:00100000:2.0:1787823628.014598:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629886464 00000100:00100000:2.0:1787823628.014647:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 237 00000100:00100000:2.0:1787823628.014658:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+31:11629:x1874668629886464:12345-192.168.202.35@tcp:54:lfs.0 00010000:00010000:2.0:1787823628.014731:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b8324826bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823628.014749:0:7893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b8324826bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823628.014793:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b8324826bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823628.014823:0:7893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b8324826bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823628.014831:0:7893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b8324826bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823628.014838:0:7893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b8324826bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823628.014844:0:7893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d2c00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823628.014865:0:7893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b8324826bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823628.014874:0:7893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b8324826bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823628.014884:0:7893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e791767be00) 00010000:00010000:2.0:1787823628.014887:0:7893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787823628.014890:0:7893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b8324826bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823628.014895:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b8324826bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823628.014976:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+31:11629:x1874668629886464:12345-192.168.202.35@tcp:54:lfs.0 Request processed in 320us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823628.014982:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 237 00000100:00100000:0.0:1787823628.086223:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823628.088593:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629886592 00000100:00100000:3.0:1787823628.088606:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629886592 00000100:00100000:2.0:1787823628.088926:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 71 00000100:00100000:2.0:1787823628.088939:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+7:2355:x1874668629886592:12345-192.168.202.35@tcp:101:cat.0 00010000:00010000:2.0:1787823628.088965:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823628.088988:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b8324826c3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44a7c expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787823628.089015:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a90060a, atime: 0x6a90060a, ctime: 0x6a90060a, blocks: 0xb 00010000:00010000:2.0:1787823628.089036:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=368s v=(0 0) 00010000:00010000:2.0:1787823628.089041:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823628.089051:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b8324826c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a7c expref: 8 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823628.089094:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b8324826c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a7c expref: 8 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823628.089107:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d2c00, rc 0) 00000100:00080000:0.0:1787823628.089204:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787823628.089456:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+8:2355:x1874668629886592:12345-192.168.202.35@tcp:101:cat.0 Request processed in 519us (3242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823628.089463:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 71 00000100:00100000:3.0:1787823628.092503:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823628.092620:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629886720 00000100:00100000:2.0:1787823628.092630:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629886720 00002000:00100000:2.0:1787823628.092874:0:6691:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8e793a2bb840 x1874668629886720/t0(0) o3->353832f0-fe7b-4d99-975c-a8041babed42@192.168.202.35@tcp:249/0 lens 488/0 e 0 to 0 dl 1787823639 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787823628.092886:0:6691:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8e793a2bb840 with x1874668629886720 ext(0->4095) 00002000:00010000:2.0:1787823628.092892:0:6691:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e793a2bb840 00000100:00100000:2.0:1787823628.092980:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 7 00000100:00100000:2.0:1787823628.092991:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2bb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:353832f0-fe7b-4d99-975c-a8041babed42+8:2354:x1874668629886720:12345-192.168.202.35@tcp:3:cat.0 00000100:00100000:2.0:1787823628.093274:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2bb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:353832f0-fe7b-4d99-975c-a8041babed42+8:2354:x1874668629886720:12345-192.168.202.35@tcp:3:cat.0 Request processed in 283us (777us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787823628.093282:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 7 00002000:00100000:2.0:1787823628.093290:0:6691:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8e793a2bb840 x1874668629886720/t0(0) o3->353832f0-fe7b-4d99-975c-a8041babed42@192.168.202.35@tcp:249/0 lens 488/4536 e 0 to 0 dl 1787823639 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787823628.093298:0:6691:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8e793a2bb840 with x1874668629886720 ext(0->4095) 00002000:00010000:2.0:1787823628.093302:0:6691:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e793a2bb840 00010000:00010000:3.0:1787823628.525319:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787823629.330137:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1787823629.330158:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:2.0:1787823629.545998:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787823629.804016:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787823629.804039:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651888640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787823629.804110:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823629.805095:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651888640 00000100:00100000:3.0:1787823629.805123:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651888640 00000100:00100000:3.0:1787823629.805196:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787823629.805206:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651888640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787823629.805253:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787823629.805324:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651888640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823629.805332:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787823629.805370:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1787823629.805376:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:3.0:1787823629.805398:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e793a49c3c0, transno 4294967310 00000100:00100000:3.0:1787823629.805418:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651888640:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787823629.805892:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787823630.570191:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787823630.825966:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787823630.825980:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787823630.826018:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787823630.826027:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787823631.065671:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823631.065714:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823631.065738:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823631.065769:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823631.065795:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823631.065820:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629887360 00000100:00100000:0.0:1787823631.065820:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629887104 00000100:00100000:1.0:1787823631.065830:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629887360 00000100:00100000:0.0:1787823631.065830:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629887104 00000100:00100000:2.0:1787823631.065931:0:12475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629887232 00000100:00100000:2.0:1787823631.065936:0:12475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629887232 00000100:00100000:3.0:1787823631.065988:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629886848 00000100:00100000:3.0:1787823631.065993:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629886848 00000100:00100000:3.0:1787823631.066039:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 300 00000100:00100000:3.0:1787823631.066049:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+13:2352:x1874668629886848:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787823631.066118:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29690577-71bc-48f4-b24d-bdb875faaf85+13:2352:x1874668629886848:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 70us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823631.066125:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 300 00000100:00100000:3.0:1787823631.066155:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629886976 00000100:00100000:3.0:1787823631.066158:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629886976 00000100:00100000:0.0:1787823631.066218:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 95 00000100:00100000:0.0:1787823631.066226:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e93c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:353832f0-fe7b-4d99-975c-a8041babed42+5:2352:x1874668629887104:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787823631.066255:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e93c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:353832f0-fe7b-4d99-975c-a8041babed42+5:2352:x1874668629887104:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 32us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823631.066262:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 95 00000100:00100000:1.0:1787823631.074338:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 160 00000100:00100000:1.0:1787823631.074361:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793516b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2352:x1874668629887360:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787823631.074453:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793516b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:2352:x1874668629887360:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 102us (8713us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823631.074476:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 160 00000100:00100000:2.0:1787823631.080025:0:12475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 96 00000100:00100000:2.0:1787823631.080043:0:12475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a49e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:353832f0-fe7b-4d99-975c-a8041babed42+8:2352:x1874668629887232:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787823631.080121:0:12475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a49e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:353832f0-fe7b-4d99-975c-a8041babed42+8:2352:x1874668629887232:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 83us (14324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823631.080128:0:12475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 96 00000100:00100000:3.0:1787823631.081544:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 161 00000100:00100000:3.0:1787823631.081555:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a49c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+31:2352:x1874668629886976:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787823631.081627:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a49c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:353832f0-fe7b-4d99-975c-a8041babed42+31:2352:x1874668629886976:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 75us (15870us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823631.081640:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 161 00000100:00080000:0.0:1787823631.085613:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787823631.085623:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787823631.085626:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787823631.600342:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787823631.854101:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874668651888896:0@lo:400:kworker.0 00000100:00100000:2.0:1787823631.854185:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823631.854243:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a03e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651889408:0@lo:400:kworker.0 00000100:00100000:2.0:1787823631.854269:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823631.854300:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787823631.854306:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651888768:0@lo:400:kworker.0 00000100:00100000:3.0:1787823631.855446:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874668651889024:0@lo:400:kworker.0 00000100:00100000:3.0:1787823631.855493:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823631.855525:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787823631.855531:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651889152:0@lo:400:kworker.0 00000100:00100000:3.0:1787823631.855551:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823631.855589:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651888896 00000100:00100000:3.0:1787823631.855595:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651888896 00000100:00100000:3.0:1787823631.855865:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651889024 00000100:00100000:3.0:1787823631.855870:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651889024 00000100:00100000:3.0:1787823631.855905:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787823631.855913:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874668651888896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823631.855964:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874668651888896:12345-0@lo:400:kworker.0 Request processed in 52us (1779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823631.855971:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787823631.855986:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787823631.855992:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874668651889024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823631.856019:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874668651889024:12345-0@lo:400:kworker.0 Request processed in 28us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823631.856024:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787823631.856039:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651889408 00000100:00100000:3.0:1787823631.856042:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651889408 00000100:00100000:3.0:1787823631.856063:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651889152 00000100:00100000:3.0:1787823631.856076:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651889152 00000100:00100000:3.0:1787823631.856094:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787823631.856100:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792eb04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1874668651889408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823631.856128:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792eb04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1874668651889408:12345-0@lo:400:kworker.0 Request processed in 28us (1858us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823631.856133:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787823631.856141:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787823631.856146:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651889152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823631.856406:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823631.861389:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651888768 00000100:00100000:0.0:1787823631.861402:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651888768 00000100:00100000:0.0:1787823631.861462:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1787823631.861471:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3306:x1874668651888768:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787823631.861754:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787823631.861787:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787823631.861790:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787823631.861847:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874668651889024:0@lo:400:kworker.0 00000100:00100000:2.0:1787823631.863358:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a2ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874668651889280:0@lo:400:kworker.0 00000100:00100000:2.0:1787823631.863414:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823631.863455:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874668651888896:0@lo:400:kworker.0 00000100:00100000:2.0:1787823631.863467:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a03e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651889408:0@lo:400:kworker.0 00000100:00100000:1.0:1787823631.867527:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651889280 00000100:00100000:1.0:1787823631.867543:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651889280 00000100:00100000:1.0:1787823631.867621:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787823631.867632:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792eb07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874668651889280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823631.867735:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792eb07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874668651889280:12345-0@lo:400:kworker.0 Request processed in 106us (4321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823631.867743:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787823631.868161:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a2ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874668651889280:0@lo:400:kworker.0 00000100:00080000:2.0:1787823631.868473:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787823631.870208:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3306:x1874668651888768:12345-0@lo:400:kworker.0 Request processed in 8731us (15869us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823631.870221:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1787823631.870904:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651888768:0@lo:400:kworker.0 00000100:00100000:3.0:1787823631.874469:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651889152:12345-0@lo:400:kworker.0 Request processed in 18311us (18906us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823631.874493:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787823631.874671:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651889152:0@lo:400:kworker.0 00000020:00080000:3.0:1787823631.930343:0:5860:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:3.0:1787823631.930373:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1787823631.930411:0:5860:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e791004e240 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1787823631.930417:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e7918203e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e791004ee40 00000020:00080000:3.0:1787823631.930420:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e7918203400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e7939d89c00 00000020:00080000:2.0:1787823631.930880:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1787823631.931069:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:0.0:1787823631.949073:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:0.0:1787823631.949210:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000100:00100000:2.0:1787823632.361976:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a2ba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651889536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787823632.362048:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823632.363879:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651889536 00000100:00100000:3.0:1787823632.363894:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651889536 00000100:00100000:3.0:1787823632.363960:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787823632.363970:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651889536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787823632.364011:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787823632.364088:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651889536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (2040us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823632.364107:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787823632.364205:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1787823632.364212:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e793a49f840, transno 4294967322 00000004:00080000:1.0:1787823632.364232:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1787823632.364258:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a2ba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651889536:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787823632.618018:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823633.642522:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823633.847585:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823633.853149:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629887488 00000100:00100000:3.0:1787823633.853165:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629887488 00000100:00100000:3.0:1787823633.853253:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 238 00000100:00100000:3.0:1787823633.853268:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a49f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+18:11290:x1874668629887488:12345-192.168.202.35@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787823633.853380:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a49f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+18:11290:x1874668629887488:12345-192.168.202.35@tcp:60:lhsmtool_posix.0 Request processed in 117us (5806us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823633.853388:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 238 00000100:00080000:2.0:1787823633.853693:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787823633.865421:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823633.865523:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629887744 00000100:00100000:2.0:1787823633.865532:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629887744 00000100:00100000:2.0:1787823633.865622:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 65 00000100:00100000:2.0:1787823633.865633:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7906fd6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+18:11290:x1874668629887744:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787823633.866154:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7906fd6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+19:11290:x1874668629887744:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 Request processed in 521us (742us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1787823633.866163:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 65 00000100:00100000:0.0:1787823634.272060:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823634.272158:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629887872 00000100:00100000:1.0:1787823634.272167:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629887872 00000100:00100000:1.0:1787823634.272240:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 239 00000100:00100000:1.0:1787823634.272251:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7926197c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+5:12082:x1874668629887872:12345-192.168.202.35@tcp:101:lsof.0 00010000:00010000:1.0:1787823634.272270:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823634.272289:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b8324826ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44a83 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823634.272351:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b8324826d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823634.272364:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b8324826d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823634.272392:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b8324826d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787823634.272639:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787823634.272644:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787823634.272727:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b8324826d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823634.272754:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeac00/0x5d1142b8324826ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a83 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823634.272806:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b8324826d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a83 expref: 6 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823634.272815:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e791767ba00) 00010000:00010000:1.0:1787823634.272817:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787823634.272821:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7920eea400, rc 0) 00000100:00100000:1.0:1787823634.272922:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7926197c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+6:12082:x1874668629887872:12345-192.168.202.35@tcp:101:lsof.0 Request processed in 673us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823634.272930:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 239 00000100:00080000:2.0:1787823634.273088:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787823634.666033:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823634.922054:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787823634.926813:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a03e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651889664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787823634.928946:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823634.929523:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651889664 00000100:00100000:0.0:1787823634.929534:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651889664 00000100:00100000:0.0:1787823634.930833:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787823634.930847:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2b83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651889664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787823634.930888:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787823634.930971:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2b83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651889664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (2031us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823634.930992:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787823634.935016:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a03e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651889664:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787823634.935501:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787823635.690194:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823636.176139:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823636.176269:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629888000 00000100:00100000:2.0:1787823636.176280:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629888000 00000100:00100000:2.0:1787823636.176342:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 302 00000100:00100000:2.0:1787823636.176354:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+13:2355:x1874668629888000:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787823636.176500:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+13:2355:x1874668629888000:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 148us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823636.176508:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 302 00000100:00100000:1.0:1787823636.180207:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823636.180261:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823636.180296:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823636.180338:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823636.180342:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629888512 00000100:00100000:0.0:1787823636.180352:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629888512 00000100:00080000:1.0:1787823636.180397:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787823636.180416:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629888128 00000100:00100000:0.0:1787823636.180420:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629888128 00000100:00100000:1.0:1787823636.180435:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 165 00000100:00100000:1.0:1787823636.180458:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+6:2355:x1874668629888512:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787823636.180533:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+6:2355:x1874668629888512:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 88us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823636.180577:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 166 00000100:00100000:0.0:1787823636.180589:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+19:2355:x1874668629888128:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787823636.180614:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629888256 00000100:00100000:2.0:1787823636.180619:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629888256 00000100:00100000:0.0:1787823636.180630:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:353832f0-fe7b-4d99-975c-a8041babed42+19:2355:x1874668629888128:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 44us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823636.180638:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 166 00000100:00080000:0.0:1787823636.180662:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787823636.180665:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787823636.180690:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629888384 00000100:00100000:2.0:1787823636.180695:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629888384 00000100:00100000:2.0:1787823636.180727:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 99 00000100:00100000:2.0:1787823636.180737:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+5:2355:x1874668629888256:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787823636.180787:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+5:2355:x1874668629888256:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 53us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823636.180794:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 99 00000100:00100000:2.0:1787823636.180809:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 100 00000100:00100000:2.0:1787823636.180815:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+7:2355:x1874668629888384:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787823636.180842:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:353832f0-fe7b-4d99-975c-a8041babed42+7:2355:x1874668629888384:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 27us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823636.180850:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 100 00000100:00080000:0.0:1787823636.180894:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787823636.181397:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 165 00010000:00010000:3.0:1787823636.714128:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823636.970175:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792e80e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874668651889920:0@lo:400:kworker.0 00000100:00100000:0.0:1787823636.970191:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e79261961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651889792:0@lo:400:kworker.0 00000100:00100000:2.0:1787823636.970341:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651890176:0@lo:400:kworker.0 00000100:00100000:1.0:1787823636.970426:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e790aef1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874668651890048:0@lo:400:kworker.0 00000100:00100000:0.0:1787823636.971175:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823636.971225:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7939dc2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874668651890304:0@lo:400:kworker.0 00000100:00100000:0.0:1787823636.971252:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823636.971279:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787823636.971286:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a2803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651890432:0@lo:400:kworker.0 00000100:00100000:0.0:1787823636.971310:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823636.971344:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651889792 00000100:00100000:0.0:1787823636.971351:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651889792 00000100:00100000:0.0:1787823636.971393:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1787823636.971402:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3305:x1874668651889792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823636.971466:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3305:x1874668651889792:12345-0@lo:400:kworker.0 Request processed in 64us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823636.971485:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1787823636.971536:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e79261961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651889792:0@lo:400:kworker.0 00000100:00100000:3.0:1787823636.972222:0:12475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651890432 00000100:00100000:3.0:1787823636.972229:0:12475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651890432 00000100:00100000:3.0:1787823636.972272:0:12475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00080000:3.0:1787823636.972450:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787823636.972463:0:12475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a282d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651890432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823636.972518:0:12475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a282d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651890432:12345-0@lo:400:kworker.0 Request processed in 239us (1207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823636.972525:0:12475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787823636.973515:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a2803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651890432:0@lo:400:kworker.0 00000100:00100000:2.0:1787823636.974975:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651890304 00000100:00100000:2.0:1787823636.974988:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651890304 00000100:00100000:2.0:1787823636.975065:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787823636.975075:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874668651890304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823636.975150:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874668651890304:12345-0@lo:400:kworker.0 Request processed in 76us (3897us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823636.975157:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787823636.975482:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823636.975522:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651890176 00000100:00100000:2.0:1787823636.975526:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651890176 00000100:00100000:2.0:1787823636.975551:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787823636.975557:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a03e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651890176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823636.975616:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a03e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651890176:12345-0@lo:400:kworker.0 Request processed in 59us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823636.975632:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787823636.975718:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651890176:0@lo:400:kworker.0 00000100:00100000:2.0:1787823636.975808:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823636.975959:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651889920 00000100:00100000:2.0:1787823636.975964:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651889920 00000100:00100000:2.0:1787823636.975990:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787823636.975997:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790aef0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874668651889920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823636.976028:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790aef0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874668651889920:12345-0@lo:400:kworker.0 Request processed in 32us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823636.976034:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787823636.976059:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792e80e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874668651889920:0@lo:400:kworker.0 00000100:00100000:2.0:1787823636.976126:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7939dc2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874668651890304:0@lo:400:kworker.0 00000100:00080000:2.0:1787823636.976297:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787823636.976302:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787823636.980214:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823636.986392:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651890048 00000100:00100000:2.0:1787823636.986406:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651890048 00000100:00100000:2.0:1787823636.986487:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787823636.986498:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874668651890048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823636.986606:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874668651890048:12345-0@lo:400:kworker.0 Request processed in 110us (6596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823636.986615:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787823636.986700:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e790aef1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874668651890048:0@lo:400:kworker.0 00000100:00080000:3.0:1787823636.987400:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1787823637.042962:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:2.0:1787823637.042981:0:5860:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1787823637.043120:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1787823637.043132:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:3.0:1787823637.481986:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787823637.482264:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793f9bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651890560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787823637.482332:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823637.482959:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651890560 00000100:00100000:0.0:1787823637.482968:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651890560 00000100:00100000:0.0:1787823637.483020:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787823637.483030:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651890560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787823637.483070:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787823637.483503:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651890560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 472us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823637.483511:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787823637.483588:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793f9bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651890560:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787823637.741942:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787823637.939443:0:12719:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 05:40:37 (1787823637) 00010000:00010000:1.0:1787823638.763301:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823639.787334:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823640.042004:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793f9bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651890688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787823640.042078:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823640.042150:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651890688 00000100:00100000:3.0:1787823640.042158:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651890688 00000100:00100000:3.0:1787823640.042207:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787823640.042216:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2b8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651890688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787823640.042250:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787823640.042291:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2b8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651890688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823640.042298:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1787823640.042317:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787823640.042352:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793f9bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651890688:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1787823640.042715:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787823640.042720:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787823640.043230:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1787823640.043237:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787823640.810174:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823641.286561:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823641.286667:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823641.286704:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823641.286736:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823641.286794:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823641.286857:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629888640 00000100:00100000:1.0:1787823641.286867:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629888640 00000100:00100000:1.0:1787823641.286921:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 304 00000100:00100000:1.0:1787823641.286932:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+13:2355:x1874668629888640:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787823641.287011:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29690577-71bc-48f4-b24d-bdb875faaf85+13:2355:x1874668629888640:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 81us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823641.287018:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 304 00000100:00100000:3.0:1787823641.287751:0:12475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629889024 00000100:00100000:3.0:1787823641.287784:0:12475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629889024 00000100:00100000:3.0:1787823641.287849:0:12475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629888896 00000100:00100000:3.0:1787823641.287853:0:12475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629888896 00000100:00100000:3.0:1787823641.287879:0:12475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 103 00000100:00100000:3.0:1787823641.287888:0:12475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a281680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:353832f0-fe7b-4d99-975c-a8041babed42+7:2355:x1874668629889024:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787823641.287930:0:12475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a281680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:353832f0-fe7b-4d99-975c-a8041babed42+7:2355:x1874668629889024:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 44us (1264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823641.287937:0:12475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 103 00000100:00100000:3.0:1787823641.287949:0:12475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 104 00000100:00100000:3.0:1787823641.287955:0:12475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a280780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:353832f0-fe7b-4d99-975c-a8041babed42+5:2355:x1874668629888896:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787823641.287989:0:12475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a280780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:353832f0-fe7b-4d99-975c-a8041babed42+5:2355:x1874668629888896:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 35us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823641.287995:0:12475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 104 00000100:00080000:1.0:1787823641.289049:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787823641.289057:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787823641.289657:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629888768 00000100:00100000:2.0:1787823641.289667:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629888768 00000100:00100000:2.0:1787823641.289785:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629889152 00000100:00100000:2.0:1787823641.289790:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629889152 00000100:00100000:1.0:1787823641.290101:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 170 00000100:00100000:1.0:1787823641.290114:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+18:2355:x1874668629888768:12345-192.168.202.35@tcp:400:kworker.0 00000100:00080000:3.0:1787823641.290733:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787823641.290814:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:353832f0-fe7b-4d99-975c-a8041babed42+18:2355:x1874668629888768:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 703us (4264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823641.290834:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 170 00000100:00100000:1.0:1787823641.290856:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 171 00000100:00100000:1.0:1787823641.290864:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+6:2355:x1874668629889152:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787823641.290895:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+6:2355:x1874668629889152:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 32us (4100us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823641.290900:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 171 00010000:00010000:1.0:1787823641.834562:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823642.090112:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793f9bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651890816:0@lo:400:kworker.0 00000100:00100000:1.0:1787823642.090138:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793f9bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874668651891072:0@lo:400:kworker.0 00000100:00100000:0.0:1787823642.090195:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793f9bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874668651890944:0@lo:400:kworker.0 00000100:00100000:3.0:1787823642.090544:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823642.090554:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823642.090609:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787823642.090611:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea8cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874668651891328:0@lo:400:kworker.0 00000100:00100000:1.0:1787823642.090615:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651891200:0@lo:400:kworker.0 00000100:00100000:3.0:1787823642.090638:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823642.090641:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823642.090678:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651890816 00000100:00100000:3.0:1787823642.090686:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651890816 00000100:00100000:3.0:1787823642.090732:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1787823642.090741:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3305:x1874668651890816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823642.091150:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3305:x1874668651890816:12345-0@lo:400:kworker.0 Request processed in 408us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823642.091158:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1787823642.091165:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651891072 00000100:00100000:2.0:1787823642.091169:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651891328 00000100:00100000:1.0:1787823642.091169:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651891072 00000100:00100000:2.0:1787823642.091176:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651891328 00000100:00100000:3.0:1787823642.091194:0:12475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651891200 00000100:00100000:3.0:1787823642.091198:0:12475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651891200 00000100:00100000:3.0:1787823642.091227:0:12475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787823642.091234:0:12475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651891200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823642.091269:0:12475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651891200:12345-0@lo:400:kworker.0 Request processed in 36us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823642.091275:0:12475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787823642.091312:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793f9bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651890816:0@lo:400:kworker.0 00000100:00080000:3.0:1787823642.092178:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787823642.092185:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787823642.092219:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651891200:0@lo:400:kworker.0 00000100:00100000:2.0:1787823642.094517:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787823642.094537:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874668651891072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823642.094636:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874668651891072:12345-0@lo:400:kworker.0 Request processed in 106us (4092us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823642.094645:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787823642.094717:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787823642.094729:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874668651891328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823642.094798:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793f9bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874668651891072:0@lo:400:kworker.0 00000100:00100000:2.0:1787823642.094800:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874668651891328:12345-0@lo:400:kworker.0 Request processed in 72us (4158us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823642.094811:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787823642.094854:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea8cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874668651891328:0@lo:400:kworker.0 00000100:00100000:0.0:1787823642.102152:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823642.102197:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea8d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651891456:0@lo:400:kworker.0 00000100:00100000:0.0:1787823642.102239:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823642.102414:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651890944 00000100:00100000:2.0:1787823642.102423:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651890944 00000100:00100000:2.0:1787823642.102475:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787823642.102486:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a280f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874668651890944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823642.103251:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a280f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874668651890944:12345-0@lo:400:kworker.0 Request processed in 764us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823642.103261:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787823642.103694:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651891456 00000100:00100000:0.0:1787823642.103698:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651891456 00000100:00100000:0.0:1787823642.103733:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787823642.103738:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651891456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823642.103797:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651891456:12345-0@lo:400:kworker.0 Request processed in 58us (1558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823642.103803:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787823642.105549:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea8d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651891456:0@lo:400:kworker.0 00000100:00100000:0.0:1787823642.105606:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793f9bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874668651890944:0@lo:400:kworker.0 00000100:00080000:2.0:1787823642.105809:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787823642.294879:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823642.297181:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629889408 00000100:00100000:0.0:1787823642.297196:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629889408 00000100:00100000:1.0:1787823642.302582:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 66 00000100:00100000:1.0:1787823642.302608:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+18:12303:x1874668629889408:12345-192.168.202.35@tcp:35:umount.0 00000100:00100000:1.0:1787823642.303209:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+19:12303:x1874668629889408:12345-192.168.202.35@tcp:35:umount.0 Request processed in 611us (8336us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1787823642.303218:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 66 00000100:00100000:3.0:1787823642.309301:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823642.310020:0:12014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629889664 00000100:00100000:0.0:1787823642.310032:0:12014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629889664 00000100:00100000:0.0:1787823642.310092:0:12014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 67 00000100:00100000:0.0:1787823642.310105:0:12014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:353832f0-fe7b-4d99-975c-a8041babed42+19:12303:x1874668629889664:12345-192.168.202.35@tcp:35:umount.0 00000100:00100000:0.0:1787823642.310562:0:12014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:353832f0-fe7b-4d99-975c-a8041babed42+20:12303:x1874668629889664:12345-192.168.202.35@tcp:35:umount.0 Request processed in 459us (1271us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1787823642.310571:0:12014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 67 00000100:00100000:0.0:1787823642.317099:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823642.318153:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629889920 00000100:00100000:2.0:1787823642.318166:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629889920 00000100:00100000:2.0:1787823642.318230:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 68 00000100:00100000:2.0:1787823642.318240:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7925a4d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+20:12303:x1874668629889920:12345-192.168.202.35@tcp:35:umount.0 00000100:00100000:2.0:1787823642.318710:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7925a4d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:353832f0-fe7b-4d99-975c-a8041babed42+21:12303:x1874668629889920:12345-192.168.202.35@tcp:35:umount.0 Request processed in 470us (1674us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1787823642.318719:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 68 00000100:00100000:3.0:1787823642.322205:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823642.322342:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629890176 00000100:00100000:1.0:1787823642.322356:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629890176 00000100:00100000:1.0:1787823642.322435:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 69 00000100:00100000:1.0:1787823642.322446:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+21:12303:x1874668629890176:12345-192.168.202.35@tcp:35:umount.0 00000100:00100000:1.0:1787823642.322876:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:353832f0-fe7b-4d99-975c-a8041babed42+22:12303:x1874668629890176:12345-192.168.202.35@tcp:35:umount.0 Request processed in 430us (681us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1787823642.322899:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 69 00000100:00100000:3.0:1787823642.326748:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823642.326945:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823642.327905:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629890432 00000100:00100000:1.0:1787823642.327917:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629890432 00000100:00100000:1.0:1787823642.327974:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629890304 00000100:00100000:1.0:1787823642.327978:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629890304 00000100:00100000:1.0:1787823642.328019:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 19 00000100:00100000:1.0:1787823642.328029:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2b8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:29690577-71bc-48f4-b24d-bdb875faaf85+14:2354:x1874668629890432:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787823642.328046:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823642.328069:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e79358d2600/0x5d1142b8324816af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f445d6 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823642.328084:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823642.328140:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2b8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:29690577-71bc-48f4-b24d-bdb875faaf85+13:2354:x1874668629890432:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 112us (1403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823642.328148:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 19 00000100:00100000:1.0:1787823642.328167:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 20 00000100:00100000:1.0:1787823642.328173:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79037f1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:29690577-71bc-48f4-b24d-bdb875faaf85+12:2354:x1874668629890304:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787823642.328181:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823642.328191:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7900031800/0x5d1142b8324816e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4460e expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823642.328200:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823642.328218:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79037f1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:29690577-71bc-48f4-b24d-bdb875faaf85+11:2354:x1874668629890304:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 45us (1274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823642.328225:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 20 00000100:00100000:0.0:1787823642.334270:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823642.334471:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629890560 00000100:00100000:1.0:1787823642.334495:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629890560 00000100:00100000:1.0:1787823642.334567:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 21 00000100:00100000:1.0:1787823642.334577:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a281e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29690577-71bc-48f4-b24d-bdb875faaf85+11:2353:x1874668629890560:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787823642.334592:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823642.334613:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e79358d2000/0x5d1142b83248195d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446d9 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823642.334629:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823642.334685:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a281e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29690577-71bc-48f4-b24d-bdb875faaf85+10:2353:x1874668629890560:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 110us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823642.334693:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 21 00000100:00100000:3.0:1787823642.343572:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823642.343831:0:12475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629890944 00000100:00100000:0.0:1787823642.343841:0:12475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629890944 00000100:00100000:0.0:1787823642.343917:0:12475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 72 00000100:00100000:0.0:1787823642.343929:0:12475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:353832f0-fe7b-4d99-975c-a8041babed42+7:2351:x1874668629890944:12345-192.168.202.35@tcp:9:umount.0 00000020:00000080:0.0:1787823642.343967:0:12475:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d1142b832481c82 00000020:00010000:0.0:1787823642.343978:0:12475:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8e7938a01000: total 0 00000100:00080000:0.0:1787823642.343994:0:12475:0:(import.c:65:import_set_state_nolock()) ffff8e7938a03000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787823642.344033:0:12475:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1787823642.344330:0:12475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:353832f0-fe7b-4d99-975c-a8041babed42+5:2351:x1874668629890944:12345-192.168.202.35@tcp:9:umount.0 Request processed in 402us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823642.344354:0:12475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 72 00000020:00010000:1.0:1787823642.346796:0:7629:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8e7938a01000: total 0 00010000:00010000:1.0:1787823642.346865:0:7629:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e7938a01000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1787823642.346930:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b8324826c3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a7c expref: 4 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823642.346968:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b832482025 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448ae expref: 3 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823642.347235:0:7629:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e7938a01000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1787823642.347253:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823642.347255:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823642.347257:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823642.353638:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823642.353948:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629891072 00000100:00100000:0.0:1787823642.353959:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629891072 00000100:00100000:0.0:1787823642.354038:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 73 00000100:00100000:0.0:1787823642.354050:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2b8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+5:2351:x1874668629891072:12345-192.168.202.35@tcp:9:umount.0 00000020:00000080:0.0:1787823642.354083:0:6686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d1142b832481a21 00000100:00080000:0.0:1787823642.354094:0:6686:0:(import.c:65:import_set_state_nolock()) ffff8e792054d000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787823642.354148:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1787823642.354458:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2b8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:353832f0-fe7b-4d99-975c-a8041babed42+2:2351:x1874668629891072:12345-192.168.202.35@tcp:9:umount.0 Request processed in 410us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823642.354467:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 73 00010000:00010000:2.0:1787823642.355448:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787823642.364855:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823642.364981:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629892096 00000100:00100000:3.0:1787823642.364999:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629892096 00000100:00100000:3.0:1787823642.365055:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 240 00000100:00100000:3.0:1787823642.365064:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e790aef1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+22:2351:x1874668629892096:12345-192.168.202.35@tcp:39:umount.0 00000020:00000080:3.0:1787823642.365096:0:5839:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d1142b8324816bd 00000020:00010000:3.0:1787823642.365111:0:5839:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8e7909b96800: total 0 00000100:00080000:3.0:1787823642.365124:0:5839:0:(import.c:65:import_set_state_nolock()) ffff8e793a14f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787823642.365151:0:5839:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:0.0:1787823642.365864:0:5827:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8e7909b96800: total 0 00010000:00010000:0.0:1787823642.365904:0:5827:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e7909b96800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1787823642.365934:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e7917859e00) 00010000:00010000:0.0:1787823642.365938:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787823642.365946:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3600/0x5d1142b8324820a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448d1 expref: 22 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823642.365964:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e7917859e00) 00010000:00010000:0.0:1787823642.365967:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787823642.365971:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c600/0x5d1142b832482382 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f449a3 expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823642.366052:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e791767b200) 00010000:00010000:0.0:1787823642.366055:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787823642.366060:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2600/0x5d1142b832481ce4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f447d5 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823642.366092:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e791767b400) 00010000:00010000:0.0:1787823642.366095:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787823642.366099:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f200/0x5d1142b832481987 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446e7 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823642.366113:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e79087c9800) 00010000:00010000:0.0:1787823642.366116:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787823642.366119:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f2800/0x5d1142b832481f06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44861 expref: 18 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823642.366129:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e791767b200) 00010000:00010000:0.0:1787823642.366131:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787823642.366135:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fc00/0x5d1142b8324819f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44703 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823642.366147:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e791767be00) 00010000:00010000:0.0:1787823642.366149:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787823642.366153:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d600/0x5d1142b8324825a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a2f expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823642.366165:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e791767be00) 00010000:00010000:0.0:1787823642.366167:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787823642.366171:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482684 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a67 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823642.366181:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e791767ba00) 00010000:00010000:0.0:1787823642.366183:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787823642.366192:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e400/0x5d1142b832482087 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448ca expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823642.366205:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e7917859800) 00010000:00010000:0.0:1787823642.366207:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823642.366211:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3000/0x5d1142b8324819a3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446ee expref: 13 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823642.366223:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e791767be00) 00010000:00010000:0.0:1787823642.366226:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787823642.366229:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eebc00/0x5d1142b8324826ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a75 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823642.366242:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e79087c9800) 00010000:00010000:0.0:1787823642.366244:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787823642.366248:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a2f3a00/0x5d1142b832481fe6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44899 expref: 11 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823642.366258:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e79087c9800) 00010000:00010000:0.0:1787823642.366260:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787823642.366263:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832482010 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f448a7 expref: 10 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823642.366276:0:5827:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e7909b96800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1787823642.366287:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823642.366289:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823642.366291:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823642.366817:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e790aef1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:353832f0-fe7b-4d99-975c-a8041babed42+7:2351:x1874668629892096:12345-192.168.202.35@tcp:39:umount.0 Request processed in 1751us (1969us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1787823642.366826:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 240 00000100:00100000:3.0:1787823642.602734:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651891584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787823642.602836:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823642.603118:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651891584 00000100:00100000:1.0:1787823642.603127:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651891584 00000100:00100000:1.0:1787823642.603185:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787823642.603194:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2ba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651891584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787823642.603247:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787823642.603300:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2ba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651891584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823642.603309:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787823642.603488:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651891584:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787823642.858422:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823643.882024:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787823644.777447:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 353832f0-fe7b-4d99-975c-a8041babed42 00000020:00000080:3.0:1787823644.777457:0:6710:0:(genops.c:885:class_export_put()) final put ffff8e792054a800/353832f0-fe7b-4d99-975c-a8041babed42 00000020:00000080:0.0:1787823644.777950:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e792054a800/353832f0-fe7b-4d99-975c-a8041babed42 for lustre-OST0000 00000020:00000080:0.0:1787823644.778019:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e792054d000 for lustre-OST0000 00010000:00010000:2.0:1787823644.906144:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823644.992486:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823644.992534:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823644.992570:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823644.992745:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629892224 00000100:00100000:3.0:1787823644.992748:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629892480 00000100:00100000:0.0:1787823644.992755:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629892224 00000100:00100000:3.0:1787823644.992756:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629892480 00000100:00100000:0.0:1787823644.992845:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629892352 00000100:00100000:0.0:1787823644.992849:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629892352 00000100:00100000:0.0:1787823644.992874:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 22 00000100:00100000:0.0:1787823644.992884:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:29690577-71bc-48f4-b24d-bdb875faaf85+12:2352:x1874668629892224:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787823644.992900:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787823644.992987:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e793a2f2c00/0x5d1142b83248178f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44623 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823644.993006:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787823644.993069:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:29690577-71bc-48f4-b24d-bdb875faaf85+11:2352:x1874668629892224:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 186us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823644.993214:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 23 00000100:00100000:3.0:1787823644.993224:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29690577-71bc-48f4-b24d-bdb875faaf85+11:2352:x1874668629892480:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787823644.993234:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787823644.993244:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e79358d2e00/0x5d1142b832481956 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f446d2 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823644.993254:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787823644.993275:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29690577-71bc-48f4-b24d-bdb875faaf85+10:2352:x1874668629892480:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 54us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823644.993283:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 23 00000100:00100000:3.0:1787823644.993301:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 24 00000100:00100000:3.0:1787823644.993308:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29690577-71bc-48f4-b24d-bdb875faaf85+9:2352:x1874668629892352:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787823644.993315:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787823644.993323:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e793a2f3200/0x5d1142b832481796 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f4464d expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823644.993332:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787823644.993349:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29690577-71bc-48f4-b24d-bdb875faaf85+8:2352:x1874668629892352:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 43us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823644.993356:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 24 00000100:00100000:3.0:1787823645.009202:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823645.009248:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629892736 00000100:00100000:3.0:1787823645.009258:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629892736 00000100:00100000:3.0:1787823645.009331:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 241 00000100:00100000:3.0:1787823645.009341:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+6:2351:x1874668629892736:12345-192.168.202.35@tcp:39:umount.0 00000020:00000080:3.0:1787823645.009391:0:7893:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d1142b8324817a4 00000020:00010000:3.0:1787823645.009413:0:7893:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8e7908d9b800: total 0 00000100:00080000:3.0:1787823645.009419:0:7893:0:(import.c:65:import_set_state_nolock()) ffff8e7908d99000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787823645.009443:0:7893:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:1.0:1787823645.010148:0:5827:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8e7908d9b800: total 0 00010000:00010000:1.0:1787823645.010192:0:5827:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e7908d9b800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787823645.010224:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e791767ba00) 00010000:00010000:1.0:1787823645.010228:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787823645.010236:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eea400/0x5d1142b8324826d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a83 expref: 5 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823645.010259:0:5827:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e7908d9b800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1787823645.010270:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823645.010273:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823645.010275:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787823645.010302:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787823645.010500:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9+3:2351:x1874668629892736:12345-192.168.202.35@tcp:39:umount.0 Request processed in 1160us (1307us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1787823645.010521:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 241 00000100:00100000:0.0:1787823645.015983:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 22 00000100:00100000:3.0:1787823645.035420:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823645.035493:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629892992 00000100:00100000:1.0:1787823645.035502:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629892992 00000100:00100000:1.0:1787823645.035571:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 306 00000100:00100000:1.0:1787823645.035581:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+7:2351:x1874668629892992:12345-192.168.202.35@tcp:251:umount.0 00000020:00000080:1.0:1787823645.035625:0:5833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d1142b83248169a 00000020:00010000:1.0:1787823645.035633:0:5833:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8e7909b95800: total 0 00000100:00080000:1.0:1787823645.035639:0:5833:0:(import.c:65:import_set_state_nolock()) ffff8e7909b94000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787823645.035733:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29690577-71bc-48f4-b24d-bdb875faaf85+3:2351:x1874668629892992:12345-192.168.202.35@tcp:251:umount.0 Request processed in 152us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823645.035743:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 306 00000020:00010000:3.0:1787823645.036214:0:5826:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8e7909b95800: total 0 00010000:00010000:3.0:1787823645.036219:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823645.036260:0:5826:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e7909b95800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787823645.036301:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e79358d3600/0x5d1142b8324816ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44615 expref: 2 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823645.036315:0:5826:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e7909b95800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1787823645.036324:0:5826:0:(genops.c:885:class_export_put()) final put ffff8e7909b95800/29690577-71bc-48f4-b24d-bdb875faaf85 00010000:00010000:3.0:1787823645.036341:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823645.036342:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823645.036344:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787823645.036399:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7909b95800/29690577-71bc-48f4-b24d-bdb875faaf85 for MGS 00000020:00000080:1.0:1787823645.036439:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e7909b94000 for MGS 00000100:00100000:0.0:1787823645.163933:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651891712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787823645.164019:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823645.170486:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651891712 00000100:00100000:1.0:1787823645.170500:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651891712 00000100:00100000:1.0:1787823645.170585:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787823645.170597:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a283c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651891712:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787823645.170603:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1787823645.170640:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787823645.170719:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a283c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651891712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (6700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823645.170725:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787823645.170828:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651891712:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787823645.930009:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787823646.751597:0:12918:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787823646.786066:0:12918:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1787823646.786120:0:12918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a2f2400/0x5d1142b83248172d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481734 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823646.786135:0:12918:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a2f2400/0x5d1142b83248172d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b832481734 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823646.786142:0:12918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a2f2400/0x5d1142b83248172d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d1142b832481734 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823646.786149:0:12918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff8e793a2f2400/0x5d1142b83248172d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d1142b832481734 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823646.786187:0:12918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787823646.786193:0:12918:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787823646.786213:0:12918:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787823646.786217:0:12918:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787823646.786222:0:12918:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787823646.786246:0:12918:0:(import.c:65:import_set_state_nolock()) ffff8e793a7ff800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787823646.786360:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea8d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874668651891840:0@lo:39:umount.0 00000100:00100000:0.0:1787823646.786428:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787823646.786851:0:7630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787823646.786859:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e793a2f2400/0x5d1142b83248172d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d1142b832481734 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823646.786866:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f2400 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:2.0:1787823646.786869:0:7630:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e793a2f2400/0x5d1142b83248172d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d1142b832481734 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823646.786877:0:7630:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e793a2f2400/0x5d1142b83248172d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d1142b832481734 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787823646.786884:0:7630:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e793a2f2400/0x5d1142b83248172d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d1142b832481734 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787823646.786889:0:7630:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787823646.786892:0:7630:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787823646.786894:0:7630:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787823646.786919:0:7630:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e793a2f2400/0x5d1142b83248172d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d1142b832481734 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823646.786930:0:7630:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787823646.786953:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e793a2f2400/0x5d1142b83248172d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d1142b832481734 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823646.786960:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e793a2f2400/0x5d1142b83248172d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d1142b832481734 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823646.786980:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823646.786981:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823646.786983:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823646.787174:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651891840 00000100:00100000:1.0:1787823646.787182:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651891840 00000100:00100000:1.0:1787823646.787227:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787823646.787235:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a283840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874668651891840:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787823646.787259:0:5838:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d1142b8324814b7 00000100:00080000:1.0:1787823646.787272:0:5838:0:(import.c:65:import_set_state_nolock()) ffff8e79394c0800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787823646.787333:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a283840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3304:x1874668651891840:12345-0@lo:39:umount.0 Request processed in 98us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823646.787341:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1787823646.787361:0:5838:0:(genops.c:885:class_export_put()) final put ffff8e79394c6800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1787823646.787380:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823646.787421:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787823646.787433:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a76f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651891968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787823646.787465:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787823646.787522:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8e793a7ff800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787823646.787531:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea8d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874668651891840:0@lo:39:umount.0 00000020:00000080:0.0:1787823646.787552:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e79394c6800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:3.0:1787823646.787663:0:12918:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787823646.787666:0:12918:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787823646.787670:0:12918:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787823646.791140:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e79394c0800 for lustre-MDT0000 00000100:00100000:1.0:1787823646.791266:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651891968 00000100:00100000:1.0:1787823646.791276:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651891968 00000100:00100000:1.0:1787823646.791370:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787823646.791381:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2821c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3306:x1874668651891968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787823646.791411:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823646.791430:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7900031000/0x5d1142b832481734 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d1142b83248172d expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823646.791445:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823646.791516:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2821c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:3306:x1874668651891968:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (4050us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823646.791523:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787823646.792690:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a76f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651891968:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787823646.796439:0:12918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a2f3e00/0x5d1142b83248173b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481742 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823646.796459:0:12918:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a2f3e00/0x5d1142b83248173b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b832481742 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823646.796466:0:12918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a2f3e00/0x5d1142b83248173b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d1142b832481742 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823646.796473:0:12918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff8e793a2f3e00/0x5d1142b83248173b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d1142b832481742 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823646.796557:0:12918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787823646.796565:0:12918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b832481654 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248165b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823646.796572:0:12918:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b832481654 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b83248165b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823646.796599:0:12918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b832481654 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d1142b83248165b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823646.796606:0:12918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b832481654 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d1142b83248165b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823646.798922:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787823646.798935:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e793a2f3e00/0x5d1142b83248173b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d1142b832481742 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823646.798945:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f3e00 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:2.0:1787823646.798949:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e793a2f3e00/0x5d1142b83248173b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d1142b832481742 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823646.798958:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e793a2f3e00/0x5d1142b83248173b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d1142b832481742 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787823646.798965:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e793a2f3e00/0x5d1142b83248173b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d1142b832481742 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787823646.798971:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787823646.798974:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1787823646.799011:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e793a2f3e00/0x5d1142b83248173b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d1142b832481742 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823646.799016:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787823646.799065:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e793a2f3e00/0x5d1142b83248173b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d1142b832481742 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823646.799072:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e793a2f3e00/0x5d1142b83248173b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d1142b832481742 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823646.799084:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787823646.799087:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b832481654 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d1142b83248165b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823646.799093:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7901677e00 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:2.0:1787823646.799097:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b832481654 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d1142b83248165b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823646.799102:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b832481654 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d1142b83248165b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787823646.799109:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b832481654 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d1142b83248165b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787823646.799113:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787823646.799115:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1787823646.799127:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b832481654 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d1142b83248165b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823646.799133:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787823646.799144:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b832481654 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d1142b83248165b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823646.799152:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823646.799153:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823646.799161:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823646.799201:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787823646.799222:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a76f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651892096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787823646.799285:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823646.799343:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7939dc2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651892224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787823646.799381:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823646.799412:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651892096 00000100:00100000:1.0:1787823646.799420:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651892096 00000100:00100000:1.0:1787823646.799458:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651892224 00000100:00100000:1.0:1787823646.799461:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651892224 00000100:00100000:1.0:1787823646.799484:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787823646.799493:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+19:3305:x1874668651892096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787823646.799505:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823646.799519:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7920eebe00/0x5d1142b832481742 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d1142b83248173b expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823646.799532:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823646.799564:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+18:3305:x1874668651892096:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823646.799571:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787823646.799586:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787823646.799599:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79037f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+17:3307:x1874668651892224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787823646.799607:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823646.799615:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7901677200/0x5d1142b83248165b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d1142b832481654 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823646.799626:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823646.799650:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79037f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+16:3307:x1874668651892224:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823646.799656:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787823646.799716:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7939dc2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651892224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787823646.799736:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a76f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651892096:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787823646.800102:0:12918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787823646.800110:0:12918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e7901677e00/0x5d1142b832481654 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d1142b83248165b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787823646.800123:0:12918:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787823646.800132:0:12918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e79358d3000/0x5d1142b832481948 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248194f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823646.800140:0:12918:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e79358d3000/0x5d1142b832481948 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b83248194f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823646.800147:0:12918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e79358d3000/0x5d1142b832481948 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d1142b83248194f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823646.800155:0:12918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff8e79358d3000/0x5d1142b832481948 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d1142b83248194f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823646.800206:0:7629:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787823646.800212:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e79358d3000/0x5d1142b832481948 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d1142b83248194f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823646.800219:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3000 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:2.0:1787823646.800222:0:7629:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e79358d3000/0x5d1142b832481948 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d1142b83248194f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823646.800229:0:7629:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e79358d3000/0x5d1142b832481948 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d1142b83248194f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787823646.800236:0:7629:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e79358d3000/0x5d1142b832481948 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d1142b83248194f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787823646.800242:0:7629:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787823646.800245:0:7629:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1787823646.800259:0:7629:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e79358d3000/0x5d1142b832481948 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d1142b83248194f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823646.800266:0:7629:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787823646.800306:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7939dc2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3308:1874668651892352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787823646.800336:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823646.800403:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651892352 00000100:00100000:1.0:1787823646.800407:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651892352 00000100:00100000:1.0:1787823646.800434:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787823646.800440:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a281a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+16:3308:x1874668651892352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787823646.800448:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823646.800457:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e793a2f3400/0x5d1142b83248194f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d1142b832481948 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823646.800465:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787823646.800502:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e79358d3000/0x5d1142b832481948 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d1142b83248194f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823646.800511:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823646.800513:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823646.800515:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823646.800567:0:12918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787823646.800572:0:12918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e79358d3000/0x5d1142b832481948 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d1142b83248194f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787823646.800581:0:12918:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787823646.800587:0:12918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7920eeb600/0x5d1142b832481408 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248140f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823646.800602:0:12918:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7920eeb600/0x5d1142b832481408 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b83248140f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823646.800608:0:12918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7920eeb600/0x5d1142b832481408 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d1142b83248140f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823646.800615:0:12918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff8e7920eeb600/0x5d1142b832481408 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d1142b83248140f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823646.800661:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a281a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+15:3308:x1874668651892352:12345-0@lo:103:ldlm_bl.0 Request processed in 220us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823646.800668:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1787823646.800748:0:7630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787823646.800754:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e7920eeb600/0x5d1142b832481408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d1142b83248140f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823646.800783:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eeb600 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:2.0:1787823646.800792:0:7630:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e7920eeb600/0x5d1142b832481408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d1142b83248140f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823646.800799:0:7630:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e7920eeb600/0x5d1142b832481408 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d1142b83248140f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787823646.800805:0:7630:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e7920eeb600/0x5d1142b832481408 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d1142b83248140f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787823646.800811:0:7630:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1787823646.800813:0:7630:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:2.0:1787823646.800827:0:7630:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e7920eeb600/0x5d1142b832481408 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d1142b83248140f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823646.800832:0:7630:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787823646.800849:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e7920eeb600/0x5d1142b832481408 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d1142b83248140f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823646.800856:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823646.800858:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823646.800859:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823646.800918:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792e80e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651892480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787823646.800942:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823646.800968:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651892480 00000100:00100000:1.0:1787823646.800977:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651892480 00000100:00100000:1.0:1787823646.801002:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787823646.801008:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+15:3305:x1874668651892480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787823646.801015:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823646.801023:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7900031a00/0x5d1142b83248140f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d1142b832481408 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823646.801033:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823646.801058:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:3305:x1874668651892480:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823646.801064:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787823646.801093:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792e80e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651892480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787823646.801185:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7939dc2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3308:1874668651892352:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787823646.801283:0:12918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787823646.801289:0:12918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e7920eeb600/0x5d1142b832481408 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d1142b83248140f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787823646.801301:0:12918:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:3.0:1787823646.801304:0:12918:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1787823646.801306:0:12918:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1787823646.801336:0:12918:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1787823646.801339:0:12918:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1787823646.801343:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787823646.801358:0:12918:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:3.0:1787823646.801363:0:12918:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8e7918296800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787823646.801369:0:12918:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8e780180c800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787823646.801376:0:12918:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8e7908d9b800 cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9 192.168.202.35@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787823646.801381:0:12918:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8e7909b96800 353832f0-fe7b-4d99-975c-a8041babed42 192.168.202.35@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967521 stale:0 00000020:00080000:3.0:1787823646.801385:0:12918:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8e7908328000) has exports, disconnecting them 00000020:00080000:3.0:1787823646.801389:0:12918:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e7918296800), last request at 1787823642 00000020:00000080:3.0:1787823646.801396:0:12918:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d1142b83248161c 00000100:00080000:3.0:1787823646.801419:0:12918:0:(import.c:65:import_set_state_nolock()) ffff8e7918296000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787823646.801459:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787823646.801547:0:12918:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e7918296800): rc 0 00000020:00000080:3.0:1787823646.801550:0:12918:0:(genops.c:885:class_export_put()) final put ffff8e7918296800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1787823646.801565:0:12918:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e780180c800), last request at 1787823642 00000020:00000080:3.0:1787823646.801569:0:12918:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d1142b832481551 00000100:00080000:3.0:1787823646.801575:0:12918:0:(import.c:65:import_set_state_nolock()) ffff8e780180d800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1787823646.801610:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7918296800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1787823646.801656:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e7918296000 for lustre-MDT0000 00010000:00010000:2.0:1787823646.801810:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787823646.801892:0:12918:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e780180c800): rc 0 00000020:00000080:3.0:1787823646.801895:0:12918:0:(genops.c:885:class_export_put()) final put ffff8e780180c800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1787823646.801909:0:12918:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa5250188bae0 00000100:00080000:3.0:1787823646.801926:0:12918:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787823646.801929:0:12918:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1787823646.801940:0:12918:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787823646.801999:0:12918:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1787823646.802011:0:12918:0:(import.c:65:import_set_state_nolock()) ffff8e7939edb000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1787823646.802022:0:12918:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787823646.802025:0:12918:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1787823646.802031:0:12918:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787823646.802089:0:12918:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1787823646.802097:0:12918:0:(import.c:65:import_set_state_nolock()) ffff8e793a14c000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1787823646.802121:0:12918:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8e7908328000) has no exports 00000100:00100000:0.0:1787823646.802179:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea8cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874668651892608:0@lo:9:umount.0 00000100:00100000:0.0:1787823646.802214:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823646.802242:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874668651892736:0@lo:9:umount.0 00000100:00100000:0.0:1787823646.802262:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823646.802364:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651892608 00000100:00100000:0.0:1787823646.802369:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651892608 00000100:00100000:0.0:1787823646.802398:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651892736 00000100:00100000:0.0:1787823646.802401:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651892736 00000100:00100000:0.0:1787823646.802428:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787823646.802435:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a282940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874668651892608:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787823646.802453:0:6687:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d1142b83248159e 00000100:00080000:0.0:1787823646.802459:0:6687:0:(import.c:65:import_set_state_nolock()) ffff8e79378e5000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1787823646.803211:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e780180c800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787823646.803258:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e780180d800 for lustre-MDT0000 00000100:00100000:3.0:1787823646.803419:0:12475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787823646.803431:0:12475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a281e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874668651892736:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787823646.803448:0:12475:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d1142b832481685 00000100:00080000:3.0:1787823646.803455:0:12475:0:(import.c:65:import_set_state_nolock()) ffff8e7939c83000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787823646.805791:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1787823646.809469:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:2.0:1787823646.809634:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823646.810065:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a282940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3304:x1874668651892608:12345-0@lo:9:umount.0 Request processed in 7625us (7844us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823646.810077:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1787823646.810112:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787823646.810293:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8e7939edb000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787823646.810310:0:3304:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787823646.810313:0:3304:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787823646.810317:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea8cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874668651892608:0@lo:9:umount.0 00000001:00000004:3.0:1787823646.811630:0:12475:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00010000:00010000:0.0:1787823646.811806:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823646.812110:0:12475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a281e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3304:x1874668651892736:12345-0@lo:9:umount.0 Request processed in 8679us (9843us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823646.812124:0:12475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1787823646.812313:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8e793a14c000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787823646.812333:0:3304:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787823646.812336:0:3304:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787823646.812346:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874668651892736:0@lo:9:umount.0 00000020:00080000:2.0:1787823646.819399:0:12918:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8e7908328000) has no exports 00000020:00000080:2.0:1787823646.931831:0:12918:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d1142b832481463 00000020:00000080:2.0:1787823646.931935:0:12918:0:(genops.c:885:class_export_put()) final put ffff8e792e6e6800/lustre-QMT0000_UUID 00000020:01000000:2.0:1787823646.931954:0:12918:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1787823646.932049:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e792e6e6800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787823646.932391:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787823646.932401:0:12918:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787823646.932508:0:12918:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8e7906ef33a0) has no exports 00000020:00000080:2.0:1787823646.934398:0:12918:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d1142b83248145c 00000020:00000080:2.0:1787823646.934408:0:12918:0:(genops.c:885:class_export_put()) final put ffff8e79394c2000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787823646.934458:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787823646.934468:0:12918:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787823646.934470:0:12918:0:(genops.c:885:class_export_put()) final put ffff8e79394c1000/lustre-QMT0000_UUID 00000020:00000080:2.0:1787823646.934472:0:12918:0:(genops.c:844:class_export_destroy()) destroying export ffff8e79394c1000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1787823646.934479:0:12918:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1787823646.935043:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e79394c2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1787823646.956018:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823647.210183:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a280b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874668651893120:0@lo:400:kworker.0 00000100:00100000:0.0:1787823647.210252:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823647.210310:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787823647.210316:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a282580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874668651892992:0@lo:400:kworker.0 00000100:00100000:0.0:1787823647.210339:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823647.210392:0:7893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651893120 00000100:00100000:0.0:1787823647.210407:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651892992 00000100:00100000:0.0:1787823647.210410:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651892992 00000100:00100000:3.0:1787823647.210411:0:7893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651893120 00000100:00100000:2.0:1787823647.210464:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a2821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651892864:0@lo:400:kworker.0 00000100:00100000:2.0:1787823647.210498:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823647.210552:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651892864 00000100:00100000:2.0:1787823647.210567:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651892864 00000100:00100000:3.0:1787823647.210708:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787823647.210716:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3308:x1874668651893120:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787823647.210723:0:7893:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787823647.210793:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3308:x1874668651893120:12345-0@lo:400:kworker.0 Request processed in 68us (533us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787823647.210800:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787823647.210998:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1787823647.211005:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7903727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:3306:x1874668651892864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823647.211058:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7903727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ea8b37-2f3c-43db-8113-f3cf41ba8d24+14:3306:x1874668651892864:12345-0@lo:400:kworker.0 Request processed in 53us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823647.211065:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1787823647.211106:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a2821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3306:1874668651892864:0@lo:400:kworker.0 00000100:00080000:2.0:1787823647.211142:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787823647.211147:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8e793a421800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787823647.211151:0:3308:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1787823647.218763:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787823647.218797:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7939dc2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3308:x1874668651892992:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787823647.218807:0:5840:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787823647.218901:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7939dc2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3308:x1874668651892992:12345-0@lo:400:kworker.0 Request processed in 105us (8560us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787823647.218908:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:2.0:1787823647.236167:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8e793a421800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787823647.236199:0:3308:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 197 00000100:00080000:2.0:1787823647.236210:0:3308:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e793a421800 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:2.0:1787823647.236252:0:3308:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e792e80e940 x1874668651893248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787823647.236281:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a280b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874668651893120:0@lo:400:kworker.0 00000100:00080000:2.0:1787823647.236331:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787823647.236335:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8e7801808800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787823647.236338:0:3308:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787823647.236341:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8e7801808800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787823647.236354:0:3308:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 177 00000100:00080000:2.0:1787823647.236359:0:3308:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e7801808800 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:2.0:1787823647.236374:0:3308:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e793a280b40 x1874668651893376/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787823647.236384:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a282580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874668651892992:0@lo:400:kworker.0 00000100:00100000:0.0:1787823647.236426:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792e80e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1874668651893248:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1787823647.236494:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823647.236535:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a280b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1874668651893376:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1787823647.236574:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823647.236617:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651893248 00000100:00100000:0.0:1787823647.236623:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651893248 00000100:00100000:0.0:1787823647.236652:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651893376 00000100:00100000:0.0:1787823647.236655:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651893376 00000100:00100000:0.0:1787823647.236674:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787823647.236681:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79261961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3304:x1874668651893248:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1787823647.236697:0:5839:0:(ldlm_lib.c:1213:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787823647.236797:0:7893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1787823647.236802:0:7893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7802e130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3304:x1874668651893376:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1787823647.236811:0:7893:0:(ldlm_lib.c:1213:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787823647.236854:0:7893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7802e130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3304:x1874668651893376:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 50us (279us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787823647.236861:0:7893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:2.0:1787823647.237098:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8e7801808800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787823647.237103:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787823647.237106:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a280b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1874668651893376:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1787823647.252069:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79261961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3304:x1874668651893248:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 15375us (15563us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787823647.252086:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:0.0:1787823647.252149:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8e793a421800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787823647.252155:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787823647.252160:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792e80e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1874668651893248:0@lo:38:ptlrpcd_00_03.0 00000001:00080000:2.0:1787823647.319870:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00080000:2.0:1787823647.319888:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:2.0:1787823647.319899:0:5860:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9 00000001:00080000:2.0:1787823647.319904:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:2.0:1787823647.319907:0:5860:0:(genops.c:885:class_export_put()) final put ffff8e7908d9b800/cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9 00000001:00100000:2.0:1787823647.319921:0:5860:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 353832f0-fe7b-4d99-975c-a8041babed42 00000001:00080000:2.0:1787823647.319926:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1787823647.319928:0:5860:0:(genops.c:885:class_export_put()) final put ffff8e7909b96800/353832f0-fe7b-4d99-975c-a8041babed42 00000020:00000080:0.0:1787823647.320225:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7908d9b800/cbcc2cac-f7d7-47b7-8dec-d75da2a6e4c9 for lustre-MDT0000 00000020:00000080:0.0:1787823647.320275:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7909b96800/353832f0-fe7b-4d99-975c-a8041babed42 for lustre-MDT0000 00000020:00000080:0.0:1787823647.320304:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e7908d99000 for lustre-MDT0000 00000020:00000080:0.0:1787823647.320309:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e793a14f000 for lustre-MDT0000 00000001:00100000:0.0:1787823647.324357:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 353832f0-fe7b-4d99-975c-a8041babed42 00000020:00000080:0.0:1787823647.324369:0:7645:0:(genops.c:885:class_export_put()) final put ffff8e7938a01000/353832f0-fe7b-4d99-975c-a8041babed42 00000001:00100000:0.0:1787823647.324399:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787823647.324402:0:7645:0:(genops.c:885:class_export_put()) final put ffff8e7939c87000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787823647.324461:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7938a01000/353832f0-fe7b-4d99-975c-a8041babed42 for lustre-OST0001 00000020:00000080:1.0:1787823647.324520:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7939c87000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787823647.324537:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e7938a03000 for lustre-OST0001 00000020:00000080:1.0:1787823647.324542:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e7939c83000 for lustre-OST0001 00010000:00010000:2.0:1787823647.978029:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787823648.937954:0:12918:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e793a7425a0 - data ffff8e790f874000/ffff8e7801805000 00000020:01000000:2.0:1787823648.938101:0:12918:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e79182f1600 - data ffff8e79197030d8/ffff8e79100ef400 00000001:00000004:2.0:1787823648.948951:0:12918:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00010000:00010000:2.0:1787823649.003934:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787823649.056451:0:12918:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787823649.056460:0:12918:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1787823649.056960:0:12918:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787823649.056964:0:12918:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787823649.061627:0:7122:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787823649.061636:0:7122:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1787823649.061652:0:7122:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1787823649.063236:0:12918:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787823649.063243:0:12918:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1787823649.063256:0:12918:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787823649.063259:0:12918:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787823649.067084:0:7934:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787823649.067090:0:7934:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1787823649.067101:0:7934:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1787823649.124326:0:12918:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d1142b83248142b 00000020:00000080:2.0:1787823649.124347:0:12918:0:(genops.c:885:class_export_put()) final put ffff8e793a7fa000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787823649.125516:0:12918:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d1142b832481440 00000020:00000080:2.0:1787823649.125527:0:12918:0:(genops.c:885:class_export_put()) final put ffff8e793a7fa800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787823649.125534:0:12918:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787823649.125539:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787823649.125548:0:12918:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787823649.125552:0:12918:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8e79083299d0) has no exports 00000004:01000000:2.0:1787823649.125715:0:12918:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787823649.125724:0:12918:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d1142b83248167e 00000020:00000080:2.0:1787823649.125729:0:12918:0:(genops.c:885:class_export_put()) final put ffff8e7939c85000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787823649.125733:0:12918:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787823649.125736:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787823649.125742:0:12918:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787823649.125744:0:12918:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8e7939cbcd70) has no exports 00000020:00000080:2.0:1787823649.125750:0:12918:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d1142b832481677 00000020:00000080:2.0:1787823649.125753:0:12918:0:(genops.c:885:class_export_put()) final put ffff8e793a14f800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1787823649.126104:0:12918:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787823649.126109:0:12918:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787823649.126113:0:12918:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1787823649.126118:0:12918:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787823649.126121:0:12918:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787823649.126149:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787823649.126156:0:12918:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787823649.126161:0:12918:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d1142b832481597 00000020:00000080:2.0:1787823649.126164:0:12918:0:(genops.c:885:class_export_put()) final put ffff8e7939ed8000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787823649.126168:0:12918:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787823649.126171:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787823649.126175:0:12918:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787823649.126177:0:12918:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8e7906f48000) has no exports 00000020:00000080:2.0:1787823649.126180:0:12918:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d1142b832481590 00000020:00000080:2.0:1787823649.126183:0:12918:0:(genops.c:885:class_export_put()) final put ffff8e7939edf000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1787823649.126508:0:12918:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787823649.126512:0:12918:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787823649.126514:0:12918:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1787823649.126517:0:12918:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787823649.126519:0:12918:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787823649.126543:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787823649.126549:0:12918:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787823649.126573:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787823649.126585:0:12918:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787823649.126613:0:12918:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d1142b832481447 00000020:00000080:2.0:1787823649.126618:0:12918:0:(genops.c:885:class_export_put()) final put ffff8e793a7f8000/lustre-MDD0000_UUID 00000020:01000000:2.0:1787823649.126622:0:12918:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787823649.126626:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787823649.126629:0:12918:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787823649.126631:0:12918:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8e790832cd70) has no exports 00000020:00000080:2.0:1787823649.126651:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787823649.126654:0:12918:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787823649.126657:0:12918:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d1142b83248144e 00000020:00000080:2.0:1787823649.126660:0:12918:0:(genops.c:885:class_export_put()) final put ffff8e793a7f8800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787823649.126666:0:12918:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e79034dc800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787823649.126669:0:12918:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e79034dc800 3 00000020:01000004:2.0:1787823649.126672:0:12918:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e79034dc800 from lustre-MDT0000 00000020:00000080:2.0:1787823649.126688:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787823649.126691:0:12918:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787823649.126694:0:12918:0:(genops.c:885:class_export_put()) final put ffff8e793a7fc800/lustre-MDT0000_UUID 00000020:00000080:2.0:1787823649.126696:0:12918:0:(genops.c:844:class_export_destroy()) destroying export ffff8e793a7fc800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787823649.126706:0:12918:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1787823649.126794:0:12918:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1787823649.126798:0:12918:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787823649.126801:0:12918:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787823649.126803:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787823649.126806:0:12918:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787823649.126814:0:12918:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8e7909be5800 08ea8b37-2f3c-43db-8113-f3cf41ba8d24 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787823649.126819:0:12918:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8e79036a19d0) has exports, disconnecting them 00000020:00080000:2.0:1787823649.126823:0:12918:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8e7909be5800), last request at 1787823416 00000020:00000080:2.0:1787823649.126837:0:12918:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d1142b8324813ec 00000020:00010000:2.0:1787823649.126841:0:12918:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8e7909be5800: total 8 00000100:00080000:2.0:1787823649.126845:0:12918:0:(import.c:65:import_set_state_nolock()) ffff8e7909be7800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787823649.126861:0:12918:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e7909be5800): rc 0 00000020:00080000:2.0:1787823649.126864:0:12918:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8e79036a19d0) has no exports 00000100:00100000:2.0:1787823649.126938:0:5832:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8e7907d65800:5832] 1 exiting: rc = 0 00000100:00100000:2.0:1787823649.127016:0:5831:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8e7908ca5600:5831] 0 exiting: rc = 1 00000020:00000080:0.0:1787823649.127404:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e793a7fa000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787823649.127431:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e793a7fa800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1787823649.127435:0:37:0:(genops.c:885:class_export_put()) final put ffff8e7935114800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787823649.127438:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7935114800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787823649.127441:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787823649.127567:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7939c85000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787823649.127573:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e793a14f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787823649.127577:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e793a14c000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787823649.127582:0:37:0:(genops.c:885:class_export_put()) final put ffff8e793a421000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787823649.127584:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e793a421000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1787823649.127587:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787823649.127617:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7939ed8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787823649.127631:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7939edf000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787823649.127635:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e7939edb000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787823649.127639:0:37:0:(genops.c:885:class_export_put()) final put ffff8e7939eda800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787823649.127641:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7939eda800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1787823649.127647:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787823649.127701:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e793a7f8000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1787823649.127705:0:37:0:(genops.c:885:class_export_put()) final put ffff8e793a7fe000/lustre-MDD0000_UUID 00000020:00000080:0.0:1787823649.127707:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e793a7fe000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1787823649.127710:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1787823649.127892:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e793a7f8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:0.0:1787823649.127906:0:5827:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8e7909be5800: total 0 00010000:00010000:0.0:1787823649.127924:0:5827:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e7909be5800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1787823649.127951:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7900030800/0x5d1142b8324816fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d1142b8324816f5 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823649.127968:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7900031400/0x5d1142b83248170a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d1142b832481703 expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823649.127980:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7920eeb800/0x5d1142b832481718 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d1142b832481711 expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823649.127993:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e793a40ee00/0x5d1142b832481933 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d1142b83248192c expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823649.128003:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e793a2f2000/0x5d1142b832481941 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d1142b83248193a expref: 5 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823649.128016:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e793a2f3c00/0x5d1142b832481726 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d1142b83248171f expref: 4 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823649.128037:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e79013a2e00/0x5d1142b832481504 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d1142b8324814fd expref: 3 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823649.128049:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e79358d3200/0x5d1142b832481750 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d1142b832481749 expref: 2 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823649.128059:0:5827:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e7909be5800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1787823649.128071:0:5827:0:(genops.c:885:class_export_put()) final put ffff8e7909be5800/08ea8b37-2f3c-43db-8113-f3cf41ba8d24 00010000:00010000:0.0:1787823649.128088:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823649.128090:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823649.128092:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823649.128665:0:5833:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8e7903618400:5833] 2 exiting: rc = 0 00000100:00100000:0.0:1787823649.128860:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.128868:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.128876:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.128882:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.128889:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.128896:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.128901:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.128907:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.128912:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.128917:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.128923:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.128928:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.128935:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.128940:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.128946:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.128952:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.128958:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.128963:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.128969:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.128975:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.128989:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.128994:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129000:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129007:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129012:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129018:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129023:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129029:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129037:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129041:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129046:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129051:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129055:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129060:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129065:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129071:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129077:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129082:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129087:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129093:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129098:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129104:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129109:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129114:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129119:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129124:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129130:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129135:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129141:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129146:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129151:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129155:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129160:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129165:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129169:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129182:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129186:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129191:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129196:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129201:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129207:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129211:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129216:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.129221:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1787823649.129842:0:12918:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787823649.129846:0:12918:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:2.0:1787823649.130659:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7909be5800/08ea8b37-2f3c-43db-8113-f3cf41ba8d24 for MGS 00000020:00000080:2.0:1787823649.130704:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e7909be7800 for MGS 00000020:01000000:0.0:1787823649.134298:0:12918:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e79260dad80 - data ffff8e790222c798/ffff8e793f980800 00000020:01000000:0.0:1787823649.134611:0:12918:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e7903770780 - data ffff8e791fb83948/ffff8e7938b24c00 00000020:00000080:0.0:1787823649.135167:0:12918:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d1142b8324813d0 00000020:00000080:0.0:1787823649.135176:0:12918:0:(genops.c:885:class_export_put()) final put ffff8e7907d31000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787823649.135236:0:12918:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e79034dc800 from MGS, refs=2 00000020:01000004:0.0:1787823649.135240:0:12918:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e79034dc800 2 00000020:01000004:0.0:1787823649.135244:0:12918:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e79034dc800 from MGS 00000020:00000080:0.0:1787823649.135272:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787823649.135279:0:12918:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1787823649.135282:0:12918:0:(genops.c:885:class_export_put()) final put ffff8e791824a800/MGS 00000020:00000080:0.0:1787823649.135285:0:12918:0:(genops.c:844:class_export_destroy()) destroying export ffff8e791824a800/MGS for MGS 00000020:01000000:0.0:1787823649.135291:0:12918:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1787823649.135356:0:12918:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1787823649.135360:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787823649.135365:0:12918:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787823649.135372:0:12918:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8e792e6e5800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787823649.135378:0:12918:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8e79036a0000) has exports, disconnecting them 00000020:00080000:0.0:1787823649.135383:0:12918:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8e792e6e5800), last request at 1787823418 00000020:00000080:0.0:1787823649.135387:0:12918:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d1142b83248149b 00000020:00080000:0.0:1787823649.135398:0:12918:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e792e6e5800): rc 0 00000020:00000080:0.0:1787823649.135402:0:12918:0:(genops.c:885:class_export_put()) final put ffff8e792e6e5800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787823649.143290:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7907d31000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787823649.143309:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e792e6e5800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1787823649.144402:0:12918:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1787823649.144409:0:12918:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787823649.144413:0:12918:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787823649.144528:0:12918:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787823649.144926:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787823649.144934:0:12918:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1787823649.144942:0:12918:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e79034dc800 1 00000020:00000080:3.0:1787823649.144948:0:12918:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d1142b8324813c2 00000020:00000080:3.0:1787823649.144957:0:12918:0:(genops.c:885:class_export_put()) final put ffff8e7918248800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1787823649.144962:0:12918:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1787823649.144968:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787823649.144971:0:12918:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787823649.144975:0:12918:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8e790832b3a0) has no exports 00000020:00000080:2.0:1787823649.145070:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e793a7ff800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787823649.145077:0:37:0:(genops.c:885:class_export_put()) final put ffff8e792e6e4800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787823649.145079:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e792e6e4800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1787823649.145088:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1787823649.145143:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7918248800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787823649.211174:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787823649.211189:0:12918:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1787823649.211194:0:12918:0:(genops.c:885:class_export_put()) final put ffff8e79034da800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787823649.211199:0:12918:0:(genops.c:844:class_export_destroy()) destroying export ffff8e79034da800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787823649.211206:0:12918:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1787823649.211350:0:12918:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e79034df000 00000020:01000000:2.0:1787823649.211372:0:12918:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1787823649.211376:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787823649.211380:0:12918:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787823649.211384:0:12918:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8e7906ef4d70) has no exports 00000100:00100000:1.0:1787823649.214130:0:7893:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8e793a27fe00:7893] 3 exiting: rc = 0 00000100:00100000:2.0:1787823649.214301:0:5838:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8e790836ae00:5838] 0 exiting: rc = 1 00000100:00100000:0.0:1787823649.214434:0:5839:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8e790702c400:5839] 1 exiting: rc = 0 00000100:00100000:3.0:1787823649.214627:0:5840:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8e79037b9800:5840] 2 exiting: rc = 0 00000100:00100000:2.0:1787823649.215098:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215105:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215110:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215117:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215123:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215128:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215133:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215139:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215145:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215149:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215155:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215175:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215180:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215185:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215190:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215195:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215201:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215206:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215212:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215217:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215357:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215363:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215369:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215374:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215380:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215385:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215391:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215396:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215401:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215406:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215412:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215532:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215538:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215544:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215550:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215556:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215562:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215567:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215573:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215579:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215584:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215590:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215595:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215600:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215605:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215610:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215623:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215628:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215633:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215638:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215643:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215648:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215652:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215657:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215662:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215668:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215673:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215678:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215683:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215688:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215693:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215698:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215704:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823649.215709:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.220477:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8e79037b8e00:5841] 0 exiting: rc = 1 00000100:00100000:0.0:1787823649.220597:0:12014:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff8e7902470c00:12014] 2 exiting: rc = 0 00000100:00100000:2.0:1787823649.221201:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8e79037b8c00:5842] 1 exiting: rc = 0 00000100:00100000:0.0:1787823649.221464:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221481:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221488:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221494:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221499:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221505:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221511:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221517:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221525:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221531:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221536:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221542:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221550:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221555:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221561:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221566:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221571:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221576:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221582:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221587:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221591:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221596:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221601:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221606:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221611:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221615:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221620:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221624:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221629:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221634:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221640:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221655:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221660:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221665:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221671:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221676:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221681:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221685:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221690:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221695:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221700:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221705:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221709:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221714:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221720:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221724:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221730:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221734:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221740:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221745:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221750:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221783:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221790:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221796:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221801:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221806:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221811:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221816:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221821:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221827:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221832:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221837:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221842:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.221848:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.222357:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8e7918675e00:5844] 1 exiting: rc = 0 00000100:00100000:2.0:1787823649.222514:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8e7918218c00:5843] 0 exiting: rc = 1 00000100:00100000:0.0:1787823649.222723:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.222735:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.222752:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.222817:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.222825:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.222832:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.222837:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.222851:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.222857:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.222863:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.222869:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.222876:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.222882:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.222888:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.222894:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.222900:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.222907:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.222916:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.222922:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.222943:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.222951:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.222956:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.222962:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.222969:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.222976:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.222982:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.222988:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.222994:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.223000:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.223005:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.223011:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.223032:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.223039:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.223044:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.223051:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.223059:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.223064:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.223077:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.223083:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.223090:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.223096:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.223102:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.223110:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.223130:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.223136:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.223141:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.223146:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.223153:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.223159:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.223164:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.223170:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.223177:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.223183:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.223189:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.223196:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.223215:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.223221:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.223228:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.223234:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.223241:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.223247:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.223254:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.223259:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.223275:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.254833:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8e79037b9e00:5846] 1 exiting: rc = 0 00000100:00100000:2.0:1787823649.254981:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8e79037b9000:5845] 0 exiting: rc = 1 00000100:00100000:0.0:1787823649.255074:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255081:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255086:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255091:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255096:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255101:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255106:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255110:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255130:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255135:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255140:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255145:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255149:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255155:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255160:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255165:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255169:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255174:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255180:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255190:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255195:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255199:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255204:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255209:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255214:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255218:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255222:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255227:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255232:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255237:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255241:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255246:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255255:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255262:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255267:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255273:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255278:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255283:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255288:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255293:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255299:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255304:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255309:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255322:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255335:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255341:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255346:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255350:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255356:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255361:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255366:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255372:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255377:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255383:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255389:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255393:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255399:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255404:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255409:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255414:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255419:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255425:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255430:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.255435:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.259494:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8e7918674800:5848] 1 exiting: rc = 0 00000100:00100000:2.0:1787823649.260027:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8e7922b94200:5847] 0 exiting: rc = 1 00000100:00100000:1.0:1787823649.260588:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260597:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260602:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260608:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260614:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260620:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260625:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260630:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260635:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260641:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260647:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260652:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260657:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260663:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260668:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260674:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260679:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260683:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260689:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260694:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260700:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260705:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260710:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260716:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260720:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260726:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260731:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260736:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260741:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260746:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260872:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260878:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260882:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260887:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260893:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260898:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260904:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260909:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260913:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260918:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260923:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260928:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260933:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260938:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260944:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260949:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260954:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260959:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260964:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260969:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260974:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260979:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260983:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260988:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260993:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.260998:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.261003:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.261009:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.261014:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.261020:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.261025:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.261030:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.261036:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.261042:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.262645:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8e7909bc8e00:5850] 1 exiting: rc = 0 00000100:00100000:2.0:1787823649.263159:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8e7918674200:5849] 0 exiting: rc = 1 00000100:00100000:1.0:1787823649.263370:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263391:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263396:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263401:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263406:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263410:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263425:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263431:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263437:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263441:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263447:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263452:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263457:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263462:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263468:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263481:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263486:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263490:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263495:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263500:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263506:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263510:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263515:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263519:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263524:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263529:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263534:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263539:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263544:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263549:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263555:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263562:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263566:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263572:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263577:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263582:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263595:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263600:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263606:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263611:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263615:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263621:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263626:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263632:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263638:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263642:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263647:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263652:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263657:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263663:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263668:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263673:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263679:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263684:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263689:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263695:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263701:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263706:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263711:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263716:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263722:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263728:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263733:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.263737:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787823649.264525:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8e79037b8800:5851] 0 exiting: rc = 1 00000100:00100000:2.0:1787823649.265665:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8e79262e0c00:5852] 1 exiting: rc = 0 00000100:00100000:2.0:1787823649.265965:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8e79262e1000:5853] 2 exiting: rc = 0 00000100:00100000:1.0:1787823649.266228:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266236:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266243:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266259:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266267:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266272:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266278:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266300:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266306:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266311:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266317:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266323:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266339:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266344:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266350:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266355:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266359:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266364:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266385:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266392:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266398:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266402:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266407:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266414:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266627:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266633:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266640:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266646:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266651:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266657:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266664:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266669:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266674:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266681:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266687:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266692:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266697:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266702:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266707:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266712:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266718:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266724:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266750:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266787:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266794:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266801:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266806:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266812:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266818:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266824:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266830:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266837:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266842:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266848:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266854:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266859:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266865:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266870:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266876:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266881:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266887:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266893:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266899:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823649.266904:0:12918:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787823649.286168:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787823649.286792:0:12918:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1787823649.286798:0:12918:0:(genops.c:885:class_export_put()) final put ffff8e7908345000/MDS_uuid 00000020:00000080:1.0:1787823649.286802:0:12918:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7908345000/MDS_uuid for MDS 00000020:01000000:1.0:1787823649.286814:0:12918:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1787823649.286955:0:12918:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000001:00100000:3.0:1787823649.922695:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787823649.922706:0:6710:0:(genops.c:885:class_export_put()) final put ffff8e79378e7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787823649.922811:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e79378e7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787823649.922858:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e79378e5000 for lustre-OST0000 00010000:00010000:1.0:1787823650.027354:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823651.050226:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823652.074964:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787823652.336627:0:12985:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787823652.336638:0:12985:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787823652.336643:0:12985:0:(import.c:65:import_set_state_nolock()) ffff8e7801808800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787823652.336655:0:12985:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 388 00000100:00080000:0.0:1787823652.336663:0:12985:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787823652.336674:0:12985:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e7801808800 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:0.0:1787823652.336705:0:12985:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e7802e121c0 x1874668651893632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787823652.336736:0:12985:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787823652.336740:0:12985:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787823652.336742:0:12985:0:(import.c:65:import_set_state_nolock()) ffff8e793a421800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787823652.336746:0:12985:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 388 00000100:00080000:0.0:1787823652.336749:0:12985:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787823652.336753:0:12985:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e793a421800 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:0.0:1787823652.336782:0:12985:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e7802e11a40 x1874668651893760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787823652.336812:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7802e13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651893504:0@lo:400:kworker.0 00000400:00000100:0.0:1787823652.336884:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874668651893504 offset 0 length 224: 4 00000100:00100000:0.0:1787823652.336971:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7802e121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1874668651893632:0@lo:38:kworker.0 00000400:00000100:0.0:1787823652.336996:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874668651893632 offset 0 length 520: 4 00000100:00100000:0.0:1787823652.337010:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7802e11a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1874668651893760:0@lo:38:kworker.0 00000400:00000100:0.0:1787823652.337025:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874668651893760 offset 0 length 520: 4 00010000:00010000:0.0:1787823653.097918:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787823653.401572:0:13073:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787823653.425861:0:13073:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1787823653.425909:0:13073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a2f3800/0x5d1142b832481711 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481718 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823653.425925:0:13073:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a2f3800/0x5d1142b832481711 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b832481718 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823653.425960:0:13073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a2f3800/0x5d1142b832481711 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d1142b832481718 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823653.425967:0:13073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff8e793a2f3800/0x5d1142b832481711 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d1142b832481718 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823653.425986:0:13073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787823653.425992:0:13073:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787823653.426022:0:13073:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787823653.426034:0:13073:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e7802e121c0 x1874668651893632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787823667 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823653.426048:0:13073:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787823653.426054:0:13073:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787823653.426061:0:13073:0:(import.c:65:import_set_state_nolock()) ffff8e7801808800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1787823653.426065:0:13073:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787823653.426068:0:13073:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e7802e121c0 x1874668651893632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787823667 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823653.426076:0:13073:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787823653.426078:0:13073:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00010000:00010000:1.0:1787823653.426473:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787823653.426481:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e793a2f3800/0x5d1142b832481711 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d1142b832481718 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823653.426501:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a2f3800 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:1.0:1787823653.426505:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e793a2f3800/0x5d1142b832481711 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d1142b832481718 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823653.426514:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e793a2f3800/0x5d1142b832481711 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d1142b832481718 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787823653.426521:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e793a2f3800/0x5d1142b832481711 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d1142b832481718 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787823653.426526:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787823653.426529:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787823653.426531:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787823653.426570:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e793a2f3800/0x5d1142b832481711 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d1142b832481718 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823653.426577:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787823653.426612:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e793a2f3800/0x5d1142b832481711 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d1142b832481718 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823653.426619:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e793a2f3800/0x5d1142b832481711 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d1142b832481718 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823653.426630:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823653.426632:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823653.426633:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823653.426647:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787823653.426663:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651893888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787823653.426738:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823653.426826:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651893888 00000100:00100000:1.0:1787823653.426833:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651893888 00000100:00100000:1.0:1787823653.426867:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787823653.426874:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3305:x1874668651893888:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787823653.426880:0:7631:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787823653 with bad export cookie 6706214679016379372 00000100:00100000:0.0:1787823653.428856:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7802e121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1874668651893632:0@lo:38:kworker.0 00010000:00010000:3.0:1787823653.440433:0:13073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b83248171f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481726 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823653.440452:0:13073:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b83248171f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b832481726 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823653.440459:0:13073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b83248171f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d1142b832481726 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823653.440484:0:13073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b83248171f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d1142b832481726 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823653.440511:0:13073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787823653.440519:0:13073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a40e800/0x5d1142b83248193a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481941 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823653.440526:0:13073:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a40e800/0x5d1142b83248193a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b832481941 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823653.440532:0:13073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a40e800/0x5d1142b83248193a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d1142b832481941 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823653.440538:0:13073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff8e793a40e800/0x5d1142b83248193a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d1142b832481941 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823653.440556:0:13073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787823653.440559:0:13073:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1787823653.440585:0:13073:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1787823653.440589:0:13073:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1787823653.440593:0:13073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787823653.440599:0:13073:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787823653.440604:0:13073:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8e79036a4d70) has no exports 00000020:00080000:3.0:1787823653.440628:0:13073:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8e79036a4d70) has no exports 00010000:00010000:2.0:1787823653.442665:0:7629:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787823653.442677:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b83248171f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d1142b832481726 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823653.442688:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eea800 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:2.0:1787823653.442692:0:7629:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b83248171f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d1142b832481726 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823653.442719:0:7629:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b83248171f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d1142b832481726 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787823653.442727:0:7629:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b83248171f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d1142b832481726 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787823653.442732:0:7629:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787823653.442736:0:7629:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1787823653.442738:0:7629:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1787823653.442795:0:7629:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b83248171f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d1142b832481726 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823653.442802:0:7629:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787823653.442828:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b83248171f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d1142b832481726 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823653.442836:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b83248171f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d1142b832481726 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823653.442853:0:7629:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787823653.442856:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e793a40e800/0x5d1142b83248193a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d1142b832481941 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823653.442862:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40e800 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:2.0:1787823653.442865:0:7629:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e793a40e800/0x5d1142b83248193a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d1142b832481941 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823653.442872:0:7629:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e793a40e800/0x5d1142b83248193a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d1142b832481941 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787823653.442889:0:7629:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e793a40e800/0x5d1142b83248193a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d1142b832481941 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787823653.442895:0:7629:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787823653.442897:0:7629:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787823653.442899:0:7629:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787823653.442912:0:7629:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e793a40e800/0x5d1142b83248193a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d1142b832481941 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823653.442918:0:7629:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787823653.442924:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e793a40e800/0x5d1142b83248193a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d1142b832481941 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823653.442941:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e793a40e800/0x5d1142b83248193a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d1142b832481941 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823653.442951:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823653.442953:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823653.442955:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787823653.442978:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651894016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787823653.443054:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823653.443108:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787823653.443114:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651894144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787823653.443135:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823653.443168:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651894016 00000100:00100000:2.0:1787823653.443174:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651894016 00000100:00100000:2.0:1787823653.443206:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651894144 00000100:00100000:2.0:1787823653.443209:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651894144 00000100:00100000:2.0:1787823653.443354:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787823653.443369:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a280f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3307:x1874668651894016:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787823653.443375:0:5825:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787823653 with bad export cookie 6706214679016379372 00000100:00100000:2.0:1787823653.443418:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a280f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3307:x1874668651894016:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (363us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787823653.443425:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787823653.443452:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787823653.443457:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a283840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3307:x1874668651894144:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787823653.443461:0:5825:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787823653 with bad export cookie 6706214679016379372 00000100:00100000:2.0:1787823653.443486:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a283840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3307:x1874668651894144:12345-0@lo:103:ldlm_bl.0 Request processed in 27us (350us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787823653.443492:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1787823653.443528:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.135@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787823653.443533:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8e7908346000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1787823653.443537:0:3307:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.135@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:3.0:1787823653.458873:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787823653.460489:0:13073:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e7909a79cc0 - data ffff8e793fc4c798/ffff8e793a343c00 00000020:01000000:0.0:1787823653.460650:0:13073:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e79101b97e0 - data ffff8e7919704a20/ffff8e780120a400 00000100:00080000:2.0:1787823653.465637:0:3307:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.135@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1787823653.465643:0:3307:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787823653.465653:0:3307:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e7802e13840 x1874668651893504/t0(0) o400->MGC192.168.202.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787823668 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823653.465684:0:3307:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e7922a0de00 x1874668651893888/t0(0) o103->MGC192.168.202.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787823669 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823653.465693:0:3307:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e793a280000 x1874668651894016/t0(0) o103->MGC192.168.202.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787823669 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823653.465702:0:3307:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e793a283480 x1874668651894144/t0(0) o103->MGC192.168.202.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787823669 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787823653.465710:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787823653.465713:0:3307:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787823653.465714:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787823653.465736:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8e7908346000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787823653.465741:0:3307:0:(import.c:510:import_select_connection()) MGC192.168.202.135@tcp: connect to NID 0@lo last attempt 157 00000100:00080000:2.0:1787823653.465750:0:3307:0:(import.c:624:import_select_connection()) MGC192.168.202.135@tcp: import ffff8e7908346000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:2.0:1787823653.466086:0:3307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e793a2803c0 x1874668651894272/t0(0) o250->MGC192.168.202.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787823653.466125:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a2803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3304:1874668651894272:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:2.0:1787823653.466174:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874668651894272 offset 0 length 520: 4 00000100:00100000:2.0:1787823653.466236:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651894016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787823653.466254:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3307:1874668651894144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787823653.466350:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651893888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787823653.466360:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7802e13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3305:1874668651893504:0@lo:400:kworker.0 00000400:00000100:3.0:1787823653.500460:0:7631:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1874668651893888 offset 224 length 224: 4 00000100:00100000:3.0:1787823653.500514:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3305:x1874668651893888:12345-0@lo:103:ldlm_bl.0 Request processed in 73637us (73783us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787823653.500535:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00100000:10000000:3.0:1787823653.517946:0:13073:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787823653.565909:0:13073:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d1142b832481520 00000020:00000080:2.0:1787823653.565918:0:13073:0:(genops.c:885:class_export_put()) final put ffff8e7903762000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1787823653.565936:0:13073:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e7909bc2800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1787823653.565940:0:13073:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e7909bc2800 2 00000020:01000004:2.0:1787823653.565943:0:13073:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e7909bc2800 from lustre-OST0000 00000020:00000080:2.0:1787823653.565965:0:13073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787823653.565975:0:13073:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1787823653.565978:0:13073:0:(genops.c:885:class_export_put()) final put ffff8e7903765800/lustre-OST0000_UUID 00000020:00000080:2.0:1787823653.565981:0:13073:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7903765800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1787823653.565987:0:13073:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1787823653.566027:0:13073:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1787823653.566031:0:13073:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787823653.566035:0:13073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787823653.566039:0:13073:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787823653.566045:0:13073:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8e780180c000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787823653.566051:0:13073:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff8e790370cd70) has exports, disconnecting them 00000020:00080000:2.0:1787823653.566056:0:13073:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8e780180c000), last request at 1787823436 00000020:00000080:2.0:1787823653.566061:0:13073:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d1142b83248154a 00000020:00080000:2.0:1787823653.566084:0:13073:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e780180c000): rc 0 00000020:00000080:2.0:1787823653.566089:0:13073:0:(genops.c:885:class_export_put()) final put ffff8e780180c000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787823653.566649:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7903762000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787823653.566661:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e780180c000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787823653.570857:0:13073:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787823653.570866:0:13073:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787823653.570881:0:13073:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787823653.570889:0:13073:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787823653.571074:0:13073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787823653.571083:0:13073:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1787823653.571090:0:13073:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e7909bc2800 1 00000020:00000080:0.0:1787823653.571097:0:13073:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d1142b8324814da 00000020:00000080:0.0:1787823653.571106:0:13073:0:(genops.c:885:class_export_put()) final put ffff8e79361cd800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1787823653.571111:0:13073:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787823653.571116:0:13073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787823653.571120:0:13073:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787823653.571123:0:13073:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8e7906ef19d0) has no exports 00000020:00000080:1.0:1787823653.571202:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e7801808800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787823653.571209:0:37:0:(genops.c:885:class_export_put()) final put ffff8e7903714000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787823653.571212:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7903714000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787823653.571221:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787823653.571274:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e79361cd800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787823653.666710:0:13073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787823653.666725:0:13073:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1787823653.666730:0:13073:0:(genops.c:885:class_export_put()) final put ffff8e79361cc000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787823653.666734:0:13073:0:(genops.c:844:class_export_destroy()) destroying export ffff8e79361cc000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1787823653.666745:0:13073:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1787823653.666916:0:13073:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e79361cb800 00000020:02000400:0.0:1787823653.666983:0:13073:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1787823654.128465:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823655.145992:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823656.173658:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787823657.060240:0:13222:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787823657.073881:0:13222:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1787823657.073959:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7920eea200/0x5d1142b8324816f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324816fc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823657.073976:0:13222:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7920eea200/0x5d1142b8324816f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b8324816fc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823657.074156:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7920eea200/0x5d1142b8324816f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d1142b8324816fc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823657.074164:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff8e7920eea200/0x5d1142b8324816f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d1142b8324816fc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823657.074188:0:13222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787823657.074193:0:13222:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787823657.074215:0:13222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787823657.074227:0:13222:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e7802e11a40 x1874668651893760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787823667 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823657.074247:0:13222:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787823657.074252:0:13222:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787823657.074267:0:13222:0:(import.c:65:import_set_state_nolock()) ffff8e793a421800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1787823657.074273:0:13222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787823657.074276:0:13222:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e7802e11a40 x1874668651893760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787823667 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823657.074283:0:13222:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00010000:00010000:1.0:1787823657.074310:0:7630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787823657.074317:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e7920eea200/0x5d1142b8324816f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d1142b8324816fc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823657.074325:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eea200 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:1.0:1787823657.074329:0:7630:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e7920eea200/0x5d1142b8324816f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d1142b8324816fc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823657.074337:0:7630:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e7920eea200/0x5d1142b8324816f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d1142b8324816fc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787823657.074344:0:7630:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e7920eea200/0x5d1142b8324816f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d1142b8324816fc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787823657.074350:0:7630:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787823657.074353:0:7630:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787823657.074355:0:7630:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787823657.074369:0:7630:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e7908346000 00010000:00010000:1.0:1787823657.074386:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e7920eea200/0x5d1142b8324816f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d1142b8324816fc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823657.074393:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e7920eea200/0x5d1142b8324816f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d1142b8324816fc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823657.074414:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823657.074417:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823657.074418:0:7630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823657.075385:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7802e11a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1874668651893760:0@lo:38:kworker.0 00000100:00100000:2.0:1787823657.075626:0:13222:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787823657.078612:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e79358d3e00/0x5d1142b832481703 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248170a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823657.078639:0:13222:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e79358d3e00/0x5d1142b832481703 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b83248170a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823657.078644:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e79358d3e00/0x5d1142b832481703 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d1142b83248170a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823657.078649:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff8e79358d3e00/0x5d1142b832481703 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d1142b83248170a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823657.078667:0:13222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787823657.078673:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7900030000/0x5d1142b83248192c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832481933 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823657.078680:0:13222:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7900030000/0x5d1142b83248192c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b832481933 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823657.078686:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7900030000/0x5d1142b83248192c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d1142b832481933 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823657.078691:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff8e7900030000/0x5d1142b83248192c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d1142b832481933 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823657.078694:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787823657.078701:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e79358d3e00/0x5d1142b832481703 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d1142b83248170a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823657.078707:0:13222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787823657.078708:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3e00 already unused, calling callback (ffffffffc1c76c20) 10000000:01000000:2.0:1787823657.078711:0:13222:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 10000000:00010000:0.0:1787823657.078712:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e79358d3e00/0x5d1142b832481703 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d1142b83248170a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823657.078719:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e79358d3e00/0x5d1142b832481703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d1142b83248170a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787823657.078725:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e79358d3e00/0x5d1142b832481703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d1142b83248170a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787823657.078730:0:13222:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1787823657.078734:0:13222:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1787823657.078738:0:13222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 10000000:01000000:0.0:1787823657.078738:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787823657.078741:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00000020:00000080:2.0:1787823657.078743:0:13222:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 10000000:01000000:0.0:1787823657.078743:0:5827:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00000020:00080000:2.0:1787823657.078747:0:13222:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8e7906f4cd70) has no exports 00010000:00010000:0.0:1787823657.078778:0:5827:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e7908346000 00010000:00010000:0.0:1787823657.078782:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e79358d3e00/0x5d1142b832481703 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d1142b83248170a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823657.078788:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e79358d3e00/0x5d1142b832481703 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d1142b83248170a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787823657.078795:0:13222:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8e7906f4cd70) has no exports 00010000:00010000:0.0:1787823657.078805:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787823657.078809:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e7900030000/0x5d1142b83248192c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d1142b832481933 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823657.078815:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7900030000 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:0.0:1787823657.078818:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e7900030000/0x5d1142b83248192c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d1142b832481933 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823657.078824:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e7900030000/0x5d1142b83248192c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d1142b832481933 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787823657.078830:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e7900030000/0x5d1142b83248192c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d1142b832481933 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787823657.078835:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787823657.078837:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787823657.078839:0:5827:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787823657.078844:0:5827:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e7908346000 00010000:00010000:0.0:1787823657.078847:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e7900030000/0x5d1142b83248192c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d1142b832481933 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823657.078859:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e7900030000/0x5d1142b83248192c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d1142b832481933 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823657.078873:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823657.078875:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823657.078877:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823657.078923:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787823657.083208:0:13222:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e7909a79b40 - data ffff8e791fbd30d8/ffff8e7801985800 00000020:01000000:2.0:1787823657.083474:0:13222:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e7918406d80 - data ffff8e791fbf4ca8/ffff8e793f98b000 00100000:10000000:3.0:1787823657.095538:0:13222:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787823657.112462:0:13222:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d1142b8324815eb 00000020:00000080:0.0:1787823657.112477:0:13222:0:(genops.c:885:class_export_put()) final put ffff8e7939c84800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1787823657.112499:0:13222:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e7903710800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1787823657.112503:0:13222:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e7903710800 2 00000020:01000004:0.0:1787823657.112506:0:13222:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e7903710800 from lustre-OST0001 00000020:00000080:0.0:1787823657.112532:0:13222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787823657.112541:0:13222:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1787823657.112545:0:13222:0:(genops.c:885:class_export_put()) final put ffff8e7939c80800/lustre-OST0001_UUID 00000020:00000080:0.0:1787823657.112548:0:13222:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7939c80800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1787823657.112555:0:13222:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1787823657.112666:0:13222:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 08ea8b37-2f3c-43db-8113-f3cf41ba8d24->MGS 00010000:00010000:0.0:1787823657.112683:0:13222:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e7901676000/0x5d1142b8324814fd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d1142b832481504 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787823657.112695:0:13222:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e7901676000/0x5d1142b8324814fd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d1142b832481504 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787823657.112701:0:13222:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1787823657.112704:0:13222:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1787823657.112708:0:13222:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1787823657.112724:0:13222:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e7908346000 00010000:00010000:0.0:1787823657.112728:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e7901676000/0x5d1142b8324814fd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d1142b832481504 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823657.112792:0:13222:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e79358d2400/0x5d1142b832481749 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d1142b832481750 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787823657.112800:0:13222:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e79358d2400/0x5d1142b832481749 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d1142b832481750 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787823657.112805:0:13222:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787823657.112807:0:13222:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1787823657.112809:0:13222:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1787823657.112819:0:13222:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e7908346000 00010000:00010000:0.0:1787823657.112822:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e79358d2400/0x5d1142b832481749 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d1142b832481750 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787823657.112838:0:13222:0:(import.c:65:import_set_state_nolock()) ffff8e7908346000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1787823657.112842:0:13222:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787823657.112844:0:13222:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787823657.112846:0:13222:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787823657.112849:0:13222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787823657.112861:0:13222:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e793a2803c0 x1874668651894272/t0(0) o250->MGC192.168.202.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787823663 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787823657.112876:0:13222:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787823657.112879:0:13222:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000020:00000080:2.0:1787823657.112942:0:12985:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7939c84800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:2.0:1787823657.113905:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a2803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:08ea8b37-2f3c-43db-8113-f3cf41ba8d24:3304:1874668651894272:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:0.0:1787823657.113974:0:13222:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787823657.114043:0:13222:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d1142b8324813de 00000020:00000080:0.0:1787823657.114050:0:13222:0:(genops.c:885:class_export_put()) final put ffff8e7908343000/08ea8b37-2f3c-43db-8113-f3cf41ba8d24 00000020:01000000:0.0:1787823657.114067:0:13222:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.135@tcp (flags='') 00000020:00000080:0.0:1787823657.114073:0:13222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787823657.114079:0:13222:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.135@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787823657.114083:0:13222:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8e7906ef0000) has no exports 00000020:00000080:2.0:1787823657.114124:0:12985:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7908343000/08ea8b37-2f3c-43db-8113-f3cf41ba8d24 for MGC192.168.202.135@tcp 10000000:01000000:1.0:1787823657.114182:0:5835:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1787823657.114273:0:13222:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.202.135@tcp: client import never connected 00000100:00080000:0.0:1787823657.114284:0:13222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1787823657.114288:0:13222:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787823657.114290:0:13222:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1787823657.114292:0:13222:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787823657.114360:0:13222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787823657.114366:0:13222:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.135@tcp (uuid 08ea8b37-2f3c-43db-8113-f3cf41ba8d24) 00000020:01000000:0.0:1787823657.114372:0:13222:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1787823657.114375:0:13222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787823657.114378:0:13222:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787823657.114383:0:13222:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8e793a426800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787823657.114388:0:13222:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff8e79037099d0) has exports, disconnecting them 00000020:00080000:0.0:1787823657.114392:0:13222:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8e793a426800), last request at 1787823456 00000020:00000080:0.0:1787823657.114397:0:13222:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d1142b832481615 00000020:00080000:0.0:1787823657.114415:0:13222:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e793a426800): rc 0 00000020:00000080:0.0:1787823657.114418:0:13222:0:(genops.c:885:class_export_put()) final put ffff8e793a426800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787823657.114587:0:12985:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e7908346000 for MGC192.168.202.135@tcp 00000020:00000080:2.0:1787823657.114593:0:12985:0:(genops.c:885:class_export_put()) final put ffff8e7908341000/08ea8b37-2f3c-43db-8113-f3cf41ba8d24 00000020:00000080:2.0:1787823657.114596:0:12985:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7908341000/08ea8b37-2f3c-43db-8113-f3cf41ba8d24 for MGC192.168.202.135@tcp 00000020:01000000:2.0:1787823657.114600:0:12985:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.135@tcp (08ea8b37-2f3c-43db-8113-f3cf41ba8d24) 00000020:00000080:2.0:1787823657.115059:0:12985:0:(genops.c:844:class_export_destroy()) destroying export ffff8e793a426800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1787823657.120844:0:13222:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1787823657.120853:0:13222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787823657.120858:0:13222:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787823657.120869:0:13222:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787823657.120995:0:12985:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e793a421800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1787823657.122823:0:7629:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1787823657.123153:0:7630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1787823657.123277:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:2.0:1787823657.123417:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:2.0:1787823657.123642:0:5822:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8e7904844200:5822] 1 exiting: rc = 0 00000100:00100000:1.0:1787823657.123830:0:5821:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8e7904844c00:5821] 0 exiting: rc = 1 00000100:00100000:2.0:1787823657.123936:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.124470:0:5825:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8e790478ea00:5825] 2 exiting: rc = 0 00000100:00100000:2.0:1787823657.124672:0:5824:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8e7908d2d000:5824] 1 exiting: rc = 0 00000100:00100000:2.0:1787823657.124730:0:8457:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff8e793a141c00:8457] 4 exiting: rc = 0 00000100:00100000:2.0:1787823657.124815:0:5823:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8e7904844800:5823] 0 exiting: rc = 1 00000100:00100000:3.0:1787823657.125102:0:7631:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8e793a0d7a00:7631] 3 exiting: rc = 0 00000100:00100000:2.0:1787823657.125241:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125249:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125255:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125271:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125278:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125284:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125290:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125309:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125317:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125322:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125328:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125334:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125339:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125344:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125351:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125357:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125363:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125367:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125372:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125378:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125384:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125389:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125395:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125536:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125543:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125549:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125555:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125561:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125567:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125572:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125577:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125582:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125586:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125591:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125595:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125600:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125605:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125610:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125614:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125619:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125623:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125627:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125642:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125648:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125653:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125659:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125664:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125669:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125675:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125680:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125684:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125689:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125695:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125700:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125706:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125712:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125716:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125721:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125725:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125730:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125735:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125742:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125751:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.125781:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787823657.126663:0:13222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787823657.126673:0:13222:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1787823657.126679:0:13222:0:(genops.c:885:class_export_put()) final put ffff8e793a422800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1787823657.126682:0:13222:0:(genops.c:844:class_export_destroy()) destroying export ffff8e793a422800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1787823657.126688:0:13222:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1787823657.126731:0:13222:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e7903710800 1 00000020:00000080:2.0:1787823657.126737:0:13222:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d1142b8324815ba 00000020:00000080:2.0:1787823657.126743:0:13222:0:(genops.c:885:class_export_put()) final put ffff8e7909b93000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1787823657.126755:0:13222:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1787823657.126791:0:12985:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7909b93000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1787823657.126803:0:13222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787823657.126817:0:13222:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787823657.126821:0:13222:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8e790370b3a0) has no exports 00000020:00000080:1.0:1787823657.141090:0:13222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787823657.141106:0:13222:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1787823657.141112:0:13222:0:(genops.c:885:class_export_put()) final put ffff8e7903712000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1787823657.141116:0:13222:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7903712000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1787823657.141125:0:13222:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1787823657.141303:0:13222:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e7903711000 00000020:01000000:1.0:1787823657.141324:0:13222:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1787823657.141329:0:13222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787823657.141333:0:13222:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787823657.141337:0:13222:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8e7903708000) has no exports 00000020:00000080:1.0:1787823657.141357:0:13222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787823657.141363:0:13222:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1787823657.141365:0:13222:0:(genops.c:885:class_export_put()) final put ffff8e79361cf800/OSS_uuid 00000020:00000080:1.0:1787823657.141368:0:13222:0:(genops.c:844:class_export_destroy()) destroying export ffff8e79361cf800/OSS_uuid for OSS 00000020:01000000:1.0:1787823657.141371:0:13222:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1787823657.142806:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8e7908d84600:6686] 0 exiting: rc = 1 00000100:00080000:1.0:1787823657.142881:0:5834:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1787823657.143132:0:12475:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8e7801bc3800:12475] 3 exiting: rc = 0 00000100:00100000:2.0:1787823657.145029:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8e7922a27e00:6687] 1 exiting: rc = 0 00000100:00100000:2.0:1787823657.145269:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8e7922a27600:6688] 2 exiting: rc = 0 00000100:00100000:1.0:1787823657.146379:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146393:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146414:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146423:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146429:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146435:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146440:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146445:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146451:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146456:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146461:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146467:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146473:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146478:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146482:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146487:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146492:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146497:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146503:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146508:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146513:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146518:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146523:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146529:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146534:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146539:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146544:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146551:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146556:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146562:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146567:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146572:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146578:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146599:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146605:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146611:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146617:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146623:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146628:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146634:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146639:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146644:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146649:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146654:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146660:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146665:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146670:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146675:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146681:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146688:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146693:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146698:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146704:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146709:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146714:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146720:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146725:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146730:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146734:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146740:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146745:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146751:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146755:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.146919:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.151817:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8e7922a27a00:6690] 1 exiting: rc = 0 00000100:00100000:3.0:1787823657.152120:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8e7922a26000:6689] 0 exiting: rc = 1 00000100:00100000:1.0:1787823657.152288:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152296:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152302:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152321:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152325:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152330:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152334:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152340:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152344:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152349:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152354:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152358:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152363:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152368:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152373:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152378:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152382:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152388:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152393:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152398:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152494:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152502:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152507:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152512:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152517:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152521:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152526:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152530:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152535:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152540:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152544:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152550:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152554:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152559:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152564:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152569:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152575:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152580:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152593:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152597:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152601:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152606:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152611:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152615:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152619:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152624:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152629:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152633:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152638:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152642:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152646:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152653:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152659:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152664:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152669:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152673:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152677:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152681:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152686:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152691:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152695:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152700:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152704:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.152709:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787823657.155475:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8e7909ab1600:6692] 1 exiting: rc = 0 00000100:00100000:1.0:1787823657.155908:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8e7909ab0e00:6691] 0 exiting: rc = 1 00000100:00100000:0.0:1787823657.156649:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8e7907e31400:6693] 2 exiting: rc = 0 00000100:00100000:1.0:1787823657.156853:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.156861:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.156867:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.156872:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.156877:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.156884:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.156889:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.156895:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.156914:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.156919:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.156925:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.156930:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.156936:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.156942:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.156948:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.156953:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.156960:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.156965:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.156971:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.156976:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157187:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157194:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157199:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157205:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157210:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157215:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157220:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157225:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157231:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157254:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157272:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157278:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157282:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157288:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157293:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157299:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157304:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157309:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157314:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157319:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157324:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157329:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157334:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157348:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157353:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157358:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157363:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157368:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157373:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157379:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157385:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157391:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157396:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157413:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157433:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157442:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157449:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157454:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157460:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157466:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157471:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157475:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157480:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.157485:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.165779:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8e790794e400:6694] 0 exiting: rc = 1 00000100:00100000:1.0:1787823657.165870:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8e792e948600:6695] 1 exiting: rc = 0 00000100:00100000:1.0:1787823657.165925:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.165932:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.165940:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.165944:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.165949:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.165954:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.165961:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.165966:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.165970:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.165976:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166277:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166285:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166302:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166307:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166312:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166317:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166323:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166328:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166333:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166337:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166342:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166347:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166354:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166358:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166363:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166368:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166373:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166379:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166384:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166389:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166394:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166412:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166418:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166423:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166429:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166434:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166438:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166443:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166449:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166454:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166459:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166463:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166468:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166473:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166477:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166483:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166488:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166501:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166506:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166511:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166515:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166520:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166524:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166529:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166534:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166538:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166542:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166549:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166554:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166560:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166565:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166570:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166576:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.166581:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.168155:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8e792e948c00:6696] 0 exiting: rc = 1 00000100:00100000:1.0:1787823657.168641:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8e792e948400:6697] 1 exiting: rc = 0 00000100:00100000:1.0:1787823657.168942:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.168950:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.168956:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.168962:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169082:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169090:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169096:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169102:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169107:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169116:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169122:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169130:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169136:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169142:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169149:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169155:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169188:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169195:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169203:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169211:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169217:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169224:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169230:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169236:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169242:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169247:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169252:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169269:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169290:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169296:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169302:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169309:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169317:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169326:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169333:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169341:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169347:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169352:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169358:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169364:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169388:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169395:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169461:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169470:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169476:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169481:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169488:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169495:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169500:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169506:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169512:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169526:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169544:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169550:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169557:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169563:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169568:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169574:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169580:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169586:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169592:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169597:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169602:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787823657.169607:0:13222:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1787823657.184557:0:13222:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1787823676.623736:0:13837:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg235-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787823687.410068:0:14298:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787823687.410075:0:14298:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1787823687.411430:0:14298:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e79358bc000 00000020:01000004:0.0:1787823687.411451:0:14298:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1787823687.411459:0:14298:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787823687.411495:0:14298:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8e792ea833a0) 00000020:00000080:0.0:1787823687.411511:0:14298:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787823687.465091:0:14298:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787823687.473386:0:14298:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1787823687.473892:0:14298:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787823687.473962:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 85: rc = 0 00100000:10000000:2.0:1787823687.485574:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 85: rc = 0 00100000:10000000:2.0:1787823687.485735:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 85: rc = 0 00100000:10000000:2.0:1787823687.485862:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 85: rc = 0 00100000:10000000:2.0:1787823687.485981:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 85: rc = 0 00100000:10000000:2.0:1787823687.486091:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 85: rc = 0 00100000:10000000:2.0:1787823687.486449:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 325: rc = 0 00100000:10000000:2.0:1787823687.487571:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 552: rc = 0 00100000:10000000:2.0:1787823687.487676:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 552: rc = 0 00100000:10000000:2.0:1787823687.488254:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 442: rc = 0 00100000:10000000:2.0:1787823687.488610:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 442: rc = 0 00100000:10000000:2.0:1787823687.488979:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 442: rc = 0 00100000:10000000:2.0:1787823687.489341:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 442: rc = 0 00100000:10000000:2.0:1787823687.489594:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 442: rc = 0 00100000:10000000:2.0:1787823687.489930:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 442: rc = 0 00100000:10000000:2.0:1787823687.490240:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 442: rc = 0 00100000:10000000:2.0:1787823687.490466:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 442: rc = 0 00100000:10000000:2.0:1787823687.490710:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 442: rc = 0 00100000:10000000:2.0:1787823687.490999:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 442: rc = 0 00100000:10000000:2.0:1787823687.491379:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 442: rc = 0 00100000:10000000:2.0:1787823687.491644:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 442: rc = 0 00100000:10000000:2.0:1787823687.492311:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 564: rc = 0 00100000:10000000:2.0:1787823687.492570:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 564: rc = 0 00100000:10000000:2.0:1787823687.492922:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 564: rc = 0 00100000:10000000:2.0:1787823687.493276:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 564: rc = 0 00100000:10000000:2.0:1787823687.493530:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 564: rc = 0 00100000:10000000:2.0:1787823687.493878:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 564: rc = 0 00100000:10000000:2.0:1787823687.494225:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 564: rc = 0 00100000:10000000:2.0:1787823687.494500:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 564: rc = 0 00100000:10000000:2.0:1787823687.494784:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 564: rc = 0 00100000:10000000:2.0:1787823687.495045:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 564: rc = 0 00100000:10000000:2.0:1787823687.495387:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 564: rc = 0 00100000:10000000:2.0:1787823687.495644:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 564: rc = 0 00100000:10000000:2.0:1787823687.496005:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 564: rc = 0 00100000:10000000:2.0:1787823687.496330:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 564: rc = 0 00100000:10000000:2.0:1787823687.496574:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 564: rc = 0 00100000:10000000:2.0:1787823687.496911:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 564: rc = 0 00100000:10000000:2.0:1787823687.497248:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 564: rc = 0 00100000:10000000:2.0:1787823687.497502:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 564: rc = 0 00100000:10000000:2.0:1787823687.497748:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 564: rc = 0 00100000:10000000:2.0:1787823687.498065:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 564: rc = 0 00100000:10000000:2.0:1787823687.498432:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 564: rc = 0 00100000:10000000:2.0:1787823687.498690:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 564: rc = 0 00100000:10000000:2.0:1787823687.499081:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 564: rc = 0 00100000:10000000:2.0:1787823687.499430:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 564: rc = 0 00100000:10000000:2.0:1787823687.499689:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 564: rc = 0 00100000:10000000:2.0:1787823687.500003:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 564: rc = 0 00100000:10000000:2.0:1787823687.500528:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 564: rc = 0 00100000:10000000:2.0:1787823687.500830:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 564: rc = 0 00100000:10000000:2.0:1787823687.501104:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 564: rc = 0 00100000:10000000:2.0:1787823687.501445:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 564: rc = 0 00100000:10000000:2.0:1787823687.501688:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 564: rc = 0 00100000:10000000:2.0:1787823687.502073:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 564: rc = 0 00100000:10000000:2.0:1787823687.502566:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 382: rc = 0 00100000:10000000:2.0:1787823687.503116:0:14298:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1787823687.503362:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 553: rc = 0 00100000:10000000:2.0:1787823687.503555:0:14298:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1787823687.503626:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 553: rc = 0 00100000:10000000:2.0:1787823687.503961:0:14298:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1787823687.504048:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 553: rc = 0 00100000:10000000:2.0:1787823687.504482:0:14298:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1787823687.504545:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 648: rc = 0 00100000:10000000:2.0:1787823687.504719:0:14298:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1787823687.504820:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 648: rc = 0 00100000:10000000:2.0:1787823687.505053:0:14298:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1787823687.505127:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 648: rc = 0 00000020:00000080:2.0:1787823687.505484:0:14298:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787823687.505494:0:14298:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787823687.505507:0:14298:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d1142b8324826df 00000020:01000004:2.0:1787823687.505515:0:14298:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787823687.505519:0:14298:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787823687.505524:0:14298:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e79358bc000 from MGS 00000020:01000004:2.0:1787823687.505528:0:14298:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787823687.505539:0:14298:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8e7906f4b3a0) 00000020:00000080:2.0:1787823687.505549:0:14298:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787823687.505603:0:14298:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e79358bc000 from MGS, refs=2 00080000:01000000:2.0:1787823687.505616:0:14298:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787823687.505621:0:14298:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d1142b8324826ed 00000100:00100000:2.0:1787823687.505719:0:14298:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787823687.505980:0:14298:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787823687.505999:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787823687.506477:0:14298:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787823687.506485:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787823687.507342:0:14298:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787823687.507519:0:14298:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787823687.507524:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787823687.508910:0:14298:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787823687.508921:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787823687.509562:0:14298:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787823687.509570:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787823687.510606:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823687.510612:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823687.510616:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823687.510754:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823687.510829:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823687.510832:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823687.511973:0:14298:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787823687.512844:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787823687.530612:0:14298:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1787823687.530630:0:14298:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787823687.530633:0:14298:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1787823687.535546:0:14308:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787823687.535815:0:14298:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787823687.535975:0:14298:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787823687.536512:0:14298:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787823687.536891:0:14298:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787823687.537068:0:14298:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787823687.537075:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787823687.543514:0:14298:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787823687.543533:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787823687.545038:0:14298:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787823687.545048:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787823687.547570:0:14298:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787823687.547592:0:14298:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.135@tcp' 00000020:01000004:0.0:1787823687.547594:0:14298:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787823687.547620:0:14298:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.135@tcp (typ=mgc) 00000020:00000080:0.0:1787823687.547630:0:14298:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.135@tcp (ffff8e792ea819d0) 00000020:00000080:0.0:1787823687.547642:0:14298:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787823687.547699:0:14298:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e791824a000@MGC192.168.202.135@tcp: add connection 192.168.202.135@tcp at head 00010000:00010000:0.0:1787823687.547859:0:14298:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.135@tcp-0 is initialized 00000040:01000000:0.0:1787823687.547865:0:14298:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.135@tcp ctxt 1 is initialized 00000100:00080000:3.0:1787823687.548142:0:14312:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1787823687.553503:0:14313:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787823687.553733:0:14298:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.135@tcp (uuid b00b7bac-c389-4a58-8ac8-b4f04764fb77) 00000020:00000080:0.0:1787823687.553802:0:14298:0:(genops.c:1385:class_connect()) connect: client b00b7bac-c389-4a58-8ac8-b4f04764fb77, cookie 0x5d1142b8324826fb 00000100:00080000:0.0:1787823687.553815:0:14298:0:(import.c:510:import_select_connection()) MGC192.168.202.135@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787823687.553821:0:14298:0:(import.c:624:import_select_connection()) MGC192.168.202.135@tcp: import ffff8e791824a000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:0.0:1787823687.553853:0:14298:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e7802e11680 x1874668651894400/t0(0) o250->MGC192.168.202.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787823687.553877:0:14298:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import b00b7bac-c389-4a58-8ac8-b4f04764fb77->MGS 00000020:01000004:0.0:1787823687.553897:0:14298:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787823687.553903:0:14298:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787823687.553917:0:14298:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8e792ea80000) 00000020:00000080:0.0:1787823687.553943:0:14298:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787823687.557400:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7802e11680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b00b7bac-c389-4a58-8ac8-b4f04764fb77:3304:1874668651894400:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787823687.557483:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823687.569389:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651894400 00000100:00100000:2.0:1787823687.569406:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651894400 00000100:00100000:2.0:1787823687.569459:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787823687.569470:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f98f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3304:x1874668651894400:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787823687.569505:0:14310:0:(ldlm_lib.c:1454:target_handle_connect()) MGS: connection from b00b7bac-c389-4a58-8ac8-b4f04764fb77@0@lo t0 exp 0000000000000000 cur 428 last 0 00000020:00000080:2.0:1787823687.569532:0:14310:0:(genops.c:1385:class_connect()) connect: client b00b7bac-c389-4a58-8ac8-b4f04764fb77, cookie 0x5d1142b832482709 00000100:00080000:2.0:1787823687.571484:0:14310:0:(import.c:65:import_set_state_nolock()) ffff8e792e6e0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787823687.574352:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f98f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+5:3304:x1874668651894400:12345-0@lo:250:mount.lustre.0 Request processed in 4873us (16858us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823687.574367:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787823687.574462:0:3304:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.135@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787823687.574474:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.135@tcp: connect to target with instance 0 00000100:00080000:2.0:1787823687.574491:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.135@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787823687.574497:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787823687.574502:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8e791824a000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787823687.574505:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787823687.574518:0:3304:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787823687.574525:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7802e11680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b00b7bac-c389-4a58-8ac8-b4f04764fb77:3304:1874668651894400:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787823687.584377:0:14298:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787823687.584755:0:14298:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787823687.587652:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787823687.593505:0:14298:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787823687.593516:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787823687.595671:0:14298:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787823687.595685:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787823687.596606:0:14298:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787823687.596866:0:14298:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787823687.596873:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787823687.597784:0:14298:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787823687.597794:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787823687.670662:0:14298:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787823687.670916:0:14298:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787823687.670923:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787823687.678602:0:14298:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787823687.678623:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787823687.679631:0:14298:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787823687.679850:0:14298:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787823687.679861:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787823687.682462:0:14298:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787823687.682479:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787823687.683195:0:14298:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787823687.683376:0:14298:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787823687.683381:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1787823687.684400:0:14298:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787823687.684410:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787823687.689882:0:14298:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787823687.690075:0:14298:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787823687.690081:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787823687.690888:0:14298:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787823687.690896:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787823687.710872:0:14298:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787823687.711383:0:14298:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787823687.711392:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787823687.713531:0:14298:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787823687.713547:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787823687.715341:0:14298:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787823687.715358:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787823687.717966:0:14298:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787823687.718003:0:14298:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1787823687.718010:0:14298:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.135@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787823687.718235:0:14298:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.135@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787823687.718269:0:14298:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.135@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1787823687.718274:0:14298:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787823687.718275:0:14298:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787823687.718277:0:14298:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787823687.718278:0:14298:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787823687.718280:0:14298:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787823687.718281:0:14298:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787823687.718285:0:14298:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787823687.718287:0:14298:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787823687.718288:0:14298:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787823687.718289:0:14298:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787823687.718292:0:14298:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1787823687.718294:0:14298:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787823687.718295:0:14298:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787823687.718296:0:14298:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787823687.718297:0:14298:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787823687.718298:0:14298:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787823687.718299:0:14298:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787823687.718300:0:14298:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787823687.718301:0:14298:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787823687.718302:0:14298:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787823687.718303:0:14298:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787823687.718332:0:14298:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787823687.718355:0:14298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea8fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14298:1874668651894528:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787823687.718444:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823687.718489:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651894528 00000100:00100000:3.0:1787823687.718496:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651894528 00000100:00100000:3.0:1787823687.718877:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787823687.718887:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f98d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+5:14298:x1874668651894528:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787823687.718936:0:14311:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787823687.718940:0:14311:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787823687.718942:0:14311:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 00000100:00100000:3.0:1787823687.719001:0:14298:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7903731480 going to sleep for 11 seconds 10000000:01000000:0.0:1787823687.719427:0:14332:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787823687.719860:0:14311:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1787823687.731467:0:14333:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1787823687.731478:0:14333:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1787823687.731481:0:14333:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1787823687.731852:0:14333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1787823687.732660:0:14311:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787823687.732673:0:14311:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787823687.741342:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f98d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+5:14298:x1874668651894528:12345-0@lo:253:mount.lustre.0 Request processed in 22444us (22885us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823687.741362:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787823687.741477:0:14298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea8fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14298:1874668651894528:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787823687.741495:0:14298:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787823687.741499:0:14298:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787823687.741501:0:14298:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787823687.741502:0:14298:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787823687.741504:0:14298:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787823687.741505:0:14298:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787823687.741506:0:14298:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787823687.741507:0:14298:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787823687.741509:0:14298:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787823687.741511:0:14298:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787823687.741512:0:14298:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787823687.741538:0:14298:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e79358bc000 from lustre-MDT0000 10000000:01000000:1.0:1787823687.741649:0:14298:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787823687.741653:0:14298:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787823687.741658:0:14298:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8e792ea819d0 10000000:01000000:1.0:1787823687.741663:0:14298:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787823687.741671:0:14298:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e792ea819d0 from 1 10000000:01000000:1.0:1787823687.741674:0:14298:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787823687.741720:0:14298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b832482710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823687.741732:0:14298:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b832482710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823687.741743:0:14298:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b832482710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823687.741873:0:14298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14298:1874668651894656:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787823687.741916:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823687.741995:0:14298:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793516f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787823687.742191:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651894656 00000100:00100000:2.0:1787823687.742199:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651894656 00000100:00100000:2.0:1787823687.742305:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787823687.742316:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f98cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+5:14298:x1874668651894656:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787823687.742329:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823687.742345:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e79358d3200/0x5d1142b832482717 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b832482710 expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823687.742368:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e79358d3200/0x5d1142b832482717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b832482710 expref: 6 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823687.742379:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e79358d3200/0x5d1142b832482717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832482710 expref: 6 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823687.742388:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d3200, rc 0) 00000100:00100000:2.0:1787823687.742428:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f98cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+6:14298:x1874668651894656:12345-0@lo:101:mount.lustre.0 Request processed in 115us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823687.742441:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787823687.742509:0:14298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14298:1874668651894656:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787823687.742522:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b832482710 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832482717 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823687.742532:0:14298:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b832482710 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b832482717 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823687.742594:0:14298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14298:1874668651894784:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787823687.742619:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823687.742956:0:14298:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793516f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787823687.743288:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651894784 00000100:00100000:0.0:1787823687.743294:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651894784 00000100:00100000:0.0:1787823687.743322:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787823687.743329:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f98c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+6:14298:x1874668651894784:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787823687.743581:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f98c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+6:14298:x1874668651894784:12345-0@lo:501:mount.lustre.0 Request processed in 252us (961us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787823687.743590:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787823687.743733:0:14298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14298:1874668651894784:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787823687.743775:0:14298:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787823687.743796:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b832482710 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832482717 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823687.743805:0:14298:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b832482710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832482717 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787823687.743813:0:14298:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e79358bc000 10000000:01000000:1.0:1787823687.743817:0:14298:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787823687.743821:0:14298:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8e79358bc000 10000000:01000000:1.0:1787823687.743823:0:14298:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787823687.743827:0:14298:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8e79358bc000 from 1 10000000:01000000:1.0:1787823687.743829:0:14298:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787823687.743850:0:14298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7920eeb200/0x5d1142b83248271e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823687.743856:0:14298:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e7920eeb200/0x5d1142b83248271e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823687.743873:0:14298:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e7920eeb200/0x5d1142b83248271e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823687.743887:0:14298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14298:1874668651894912:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787823687.743916:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823687.743936:0:14298:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793516f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787823687.743999:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651894912 00000100:00100000:2.0:1787823687.744003:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651894912 00000100:00100000:2.0:1787823687.744026:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787823687.744033:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f98e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+6:14298:x1874668651894912:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787823687.744258:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823687.744273:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e79358d3000/0x5d1142b832482725 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b83248271e expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823687.744292:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e79358d3000/0x5d1142b832482725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b83248271e expref: 7 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823687.744302:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e79358d3000/0x5d1142b832482725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b83248271e expref: 7 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823687.744310:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d3000, rc 0) 00000100:00100000:2.0:1787823687.744351:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f98e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+7:14298:x1874668651894912:12345-0@lo:101:mount.lustre.0 Request processed in 318us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823687.744356:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787823687.744434:0:14298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14298:1874668651894912:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787823687.744445:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e7920eeb200/0x5d1142b83248271e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832482725 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823687.744453:0:14298:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e7920eeb200/0x5d1142b83248271e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b832482725 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787823687.744466:0:14298:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787823687.744470:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7920eeb200/0x5d1142b83248271e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832482725 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823687.744477:0:14298:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e7920eeb200/0x5d1142b83248271e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832482725 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787823687.744484:0:14298:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787823687.744487:0:14298:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787823687.744491:0:14298:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8e79358bc000 10000000:01000000:1.0:1787823687.744495:0:14298:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787823687.744497:0:14298:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787823687.744500:0:14298:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787823687.744514:0:14298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7920eea200/0x5d1142b83248272c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823687.744529:0:14298:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e7920eea200/0x5d1142b83248272c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823687.744536:0:14298:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e7920eea200/0x5d1142b83248272c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823687.744550:0:14298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14298:1874668651895040:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787823687.744689:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823687.744716:0:14298:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793516f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787823687.744790:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651895040 00000100:00100000:0.0:1787823687.744794:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651895040 00000100:00100000:0.0:1787823687.744813:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787823687.744819:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f98e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+7:14298:x1874668651895040:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787823687.744826:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823687.744836:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e793a40f200/0x5d1142b832482733 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b83248272c expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823687.744848:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e793a40f200/0x5d1142b832482733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b83248272c expref: 8 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823687.744856:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e793a40f200/0x5d1142b832482733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b83248272c expref: 8 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823687.744874:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40f200, rc 0) 00000100:00100000:0.0:1787823687.744909:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f98e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+8:14298:x1874668651895040:12345-0@lo:101:mount.lustre.0 Request processed in 90us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823687.744916:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787823687.745240:0:14298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14298:1874668651895040:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787823687.745251:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e7920eea200/0x5d1142b83248272c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832482733 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823687.745259:0:14298:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e7920eea200/0x5d1142b83248272c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b832482733 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823687.745303:0:14298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14298:1874668651895168:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787823687.745330:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823687.745355:0:14298:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793516f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787823687.745410:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651895168 00000100:00100000:0.0:1787823687.745414:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651895168 00000100:00100000:0.0:1787823687.745446:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787823687.745452:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79182b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+8:14298:x1874668651895168:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787823687.745926:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79182b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+9:14298:x1874668651895168:12345-0@lo:501:mount.lustre.0 Request processed in 473us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823687.745933:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787823687.746242:0:14298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14298:1874668651895168:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787823687.746278:0:14298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14298:1874668651895296:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787823687.746320:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823687.746352:0:14298:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793516f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787823687.746401:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651895296 00000100:00100000:2.0:1787823687.746406:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651895296 00000100:00100000:2.0:1787823687.746437:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787823687.746444:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79182ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+9:14298:x1874668651895296:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787823687.747034:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79182ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+9:14298:x1874668651895296:12345-0@lo:503:mount.lustre.0 Request processed in 589us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823687.747044:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787823687.747431:0:14298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14298:1874668651895296:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787823687.748294:0:14334:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea8ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14334:1874668651895424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787823687.748358:0:14334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823687.748434:0:14334:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e792ea293c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787823687.748474:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651895424 00000100:00100000:2.0:1787823687.748487:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651895424 00000100:00100000:2.0:1787823687.748721:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787823687.748732:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79182b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+9:14334:x1874668651895424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787823687.749077:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79182b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+9:14334:x1874668651895424:12345-0@lo:502:llog_process_th.0 Request processed in 347us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823687.749084:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787823687.749206:0:14334:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea8ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14334:1874668651895424:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787823687.749242:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787823687.749257:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787823687.749260:0:14334:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787823687.749268:0:14334:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787823687.749271:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787823687.749288:0:14334:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8e7939cbb3a0) 00000020:00000080:3.0:1787823687.749309:0:14334:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787823687.749315:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787823687.749396:0:14334:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787823687.749404:0:14334:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d1142b832482741 00000020:00000080:3.0:1787823687.749753:0:14334:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787823687.749782:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787823687.749786:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787823687.749788:0:14334:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787823687.749791:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787823687.749794:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787823687.749795:0:14334:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787823687.749799:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787823687.749807:0:14334:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8e7939cb99d0) 00000020:00000080:3.0:1787823687.749818:0:14334:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787823687.749821:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787823687.749823:0:14334:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787823687.749825:0:14334:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787823687.749832:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787823687.749870:0:14334:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e79358bc000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787823687.749880:0:14334:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8e7939cb8000) 00000020:00000080:3.0:1787823687.749887:0:14334:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787823687.749926:0:14334:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787823687.749941:0:14334:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d1142b832482756 00000020:00000080:3.0:1787823687.750039:0:14334:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787823687.750045:0:14334:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787823687.750050:0:14334:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5d1142b83248275d 00080000:01000000:3.0:1787823687.750054:0:14334:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787823687.750057:0:14334:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d1142b832482764 00010000:00010000:2.0:1787823687.842613:0:14334:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787823687.843155:0:14334:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:2.0:1787823687.843372:0:14334:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787823687.844045:0:14334:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8e7906f499d0) 00000020:00000080:2.0:1787823687.844070:0:14334:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787823687.844131:0:14334:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787823687.844139:0:14334:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d1142b832482772 00000020:00000080:0.0:1787823687.849490:0:14334:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787823687.858197:0:14334:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5d1142b832482779 00000020:00000080:0.0:1787823687.858910:0:14334:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787823687.858941:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787823687.858967:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787823687.858970:0:14334:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787823687.858974:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787823687.858977:0:14334:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1787823687.858979:0:14334:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787823687.859009:0:14334:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787823687.859011:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787823687.859015:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787823687.859016:0:14334:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787823687.859020:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787823687.859024:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787823687.859026:0:14334:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787823687.859031:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787823687.859065:0:14334:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787823687.859086:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787823687.859089:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787823687.859090:0:14334:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1787823687.859093:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787823687.859096:0:14334:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787823687.859099:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787823687.859101:0:14334:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787823687.859104:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787823687.859109:0:14334:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.135@tcp to nid 0x20000c0a8ca87 (192.168.202.135@tcp) 00000020:01000000:0.0:1787823687.859136:0:14334:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787823687.859140:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787823687.859158:0:14334:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8e792ea84d70) 00000020:00000080:0.0:1787823687.859173:0:14334:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1787823687.859178:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787823687.859235:0:14334:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787823687.859259:0:14334:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787823687.859267:0:14334:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d1142b832482787 00010000:00080000:0.0:1787823687.859320:0:14334:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e79358ef000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.135@tcp at head 00010000:00010000:0.0:1787823687.859579:0:14334:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1787823687.860227:0:14334:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787823687.860274:0:14334:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787823687.861424:0:14334:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787823687.861488:0:14334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1787823687.861563:0:14334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1787823687.862132:0:14338:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787823687.862137:0:14338:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787823687.862712:0:14334:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787823687.862724:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787823687.862950:0:14334:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787823687.862975:0:14334:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d1142b83248278e 00000100:00080000:0.0:1787823687.862999:0:14334:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787823687.863007:0:14334:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e79358ef000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:0.0:1787823687.863051:0:14334:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e7802e10780 x1874668651895552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787823687.863089:0:14334:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787823687.863151:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787823687.863157:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787823687.863160:0:14334:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787823687.863162:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787823687.863165:0:14334:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1787823687.863168:0:14334:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787823687.863170:0:14334:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787823687.863171:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787823687.863174:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787823687.863176:0:14334:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787823687.863178:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787823687.863182:0:14334:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787823687.863186:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787823687.863187:0:14334:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787823687.863191:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787823687.863194:0:14334:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.135@tcp to nid 0x20000c0a8ca87 (192.168.202.135@tcp) 00000020:01000000:0.0:1787823687.863223:0:14334:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787823687.863226:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787823687.863250:0:14334:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8e7936e699d0) 00000020:00000080:0.0:1787823687.863262:0:14334:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1787823687.863268:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787823687.863326:0:14334:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787823687.863333:0:14334:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787823687.863341:0:14334:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d1142b83248279c 00010000:00080000:0.0:1787823687.863384:0:14334:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e7918291800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.135@tcp at head 00010000:00010000:0.0:1787823687.863602:0:14334:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1787823687.863810:0:14334:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787823687.863834:0:14334:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787823687.864366:0:14334:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787823687.864438:0:14334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1787823687.864522:0:14334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:2.0:1787823687.864726:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7802e10780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874668651895552:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787823687.864814:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874668651895552 offset 0 length 520: 4 00000040:00080000:2.0:1787823687.865434:0:14340:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787823687.865439:0:14340:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787823687.866458:0:14334:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787823687.866470:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787823687.866502:0:14334:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787823687.866522:0:14334:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d1142b8324827a3 00000100:00080000:0.0:1787823687.866531:0:14334:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787823687.866537:0:14334:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e7918291800 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:0.0:1787823687.866570:0:14334:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e7802e13480 x1874668651895680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787823687.866628:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7802e13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874668651895680:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787823687.866688:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874668651895680 offset 0 length 520: 4 00000100:00080000:0.0:1787823687.866740:0:14334:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787823687.866817:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787823687.866821:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787823687.866823:0:14334:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787823687.866826:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787823687.866831:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787823687.866832:0:14334:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787823687.866835:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787823687.866837:0:14334:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787823687.866839:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787823687.866842:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787823687.866843:0:14334:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787823687.866845:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787823687.866847:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787823687.866848:0:14334:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787823687.866852:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787823687.866879:0:14334:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7802e10f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14334:1874668651895808:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787823687.866930:0:14334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823687.866950:0:14334:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e791a680480 going to sleep for 11 seconds 00000100:00100000:3.0:1787823687.867042:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651895808 00000100:00100000:3.0:1787823687.867048:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651895808 00000100:00100000:3.0:1787823687.867094:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787823687.867103:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79182b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+9:14334:x1874668651895808:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787823687.867324:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79182b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+9:14334:x1874668651895808:12345-0@lo:502:llog_process_th.0 Request processed in 222us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823687.867332:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787823687.867480:0:14334:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7802e10f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14334:1874668651895808:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787823687.867506:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787823687.867517:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787823687.867518:0:14334:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787823687.867522:0:14334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1787823687.867659:0:14298:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1787823687.867683:0:14298:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787823687.867703:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7920eea200/0x5d1142b83248272c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832482733 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823687.867713:0:14298:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e7920eea200/0x5d1142b83248272c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832482733 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787823687.867720:0:14298:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e79358bc000 from 1 10000000:01000000:1.0:1787823687.867723:0:14298:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787823687.867748:0:14298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7920eea600/0x5d1142b8324827aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823687.867777:0:14298:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e7920eea600/0x5d1142b8324827aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823687.867786:0:14298:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e7920eea600/0x5d1142b8324827aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823687.867800:0:14298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14298:1874668651895936:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787823687.867829:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823687.867860:0:14298:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793516f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787823687.867915:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651895936 00000100:00100000:3.0:1787823687.867919:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651895936 00000100:00100000:3.0:1787823687.867943:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787823687.867950:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79182ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+9:14298:x1874668651895936:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787823687.867959:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823687.867974:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e793a26ce00/0x5d1142b8324827b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b8324827aa expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823687.868008:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e793a26ce00/0x5d1142b8324827b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b8324827aa expref: 10 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823687.868018:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e793a26ce00/0x5d1142b8324827b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b8324827aa expref: 10 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823687.868026:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a26ce00, rc 0) 00000100:00100000:3.0:1787823687.868062:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79182ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+10:14298:x1874668651895936:12345-0@lo:101:mount.lustre.0 Request processed in 113us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823687.868078:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787823687.868152:0:14298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14298:1874668651895936:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787823687.868163:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e7920eea600/0x5d1142b8324827aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324827b1 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823687.868172:0:14298:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e7920eea600/0x5d1142b8324827aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b8324827b1 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823687.868706:0:14298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14298:1874668651896064:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1787823687.868749:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823687.868804:0:14298:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793516f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787823687.869222:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651896064 00000100:00100000:0.0:1787823687.869228:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651896064 00000100:00100000:0.0:1787823687.869268:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787823687.869277:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79182bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+10:14298:x1874668651896064:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1787823687.869295:0:14309:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787823687.869302:0:14309:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787823687.869382:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79182bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+10:14298:x1874668651896064:12345-0@lo:256:mount.lustre.0 Request processed in 106us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823687.869389:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787823687.869519:0:14298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14298:1874668651896064:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1787823687.870225:0:14298:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787823687.870243:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7920eea600/0x5d1142b8324827aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324827b1 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823687.870255:0:14298:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e7920eea600/0x5d1142b8324827aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324827b1 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787823687.870264:0:14298:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e79358bc000 from 1 10000000:01000000:1.0:1787823687.870267:0:14298:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787823687.870300:0:14298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7920eeaa00/0x5d1142b8324827b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823687.870308:0:14298:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e7920eeaa00/0x5d1142b8324827b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823687.870316:0:14298:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e7920eeaa00/0x5d1142b8324827b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823687.870334:0:14298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14298:1874668651896192:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787823687.870374:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823687.870549:0:14298:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793516f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787823687.870661:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651896192 00000100:00100000:3.0:1787823687.870668:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651896192 00000100:00100000:3.0:1787823687.870733:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787823687.870742:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79182bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+10:14298:x1874668651896192:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787823687.870753:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823687.870794:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e793a26d400/0x5d1142b8324827bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b8324827b8 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823687.870816:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e793a26d400/0x5d1142b8324827bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b8324827b8 expref: 11 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823687.870825:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e793a26d400/0x5d1142b8324827bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b8324827b8 expref: 11 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823687.870833:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a26d400, rc 0) 00000100:00100000:3.0:1787823687.870879:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79182bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+11:14298:x1874668651896192:12345-0@lo:101:mount.lustre.0 Request processed in 137us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823687.870885:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787823687.870960:0:14298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14298:1874668651896192:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787823687.870974:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e7920eeaa00/0x5d1142b8324827b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324827bf expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823687.871007:0:14298:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e7920eeaa00/0x5d1142b8324827b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b8324827bf expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823687.871063:0:14298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14298:1874668651896320:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787823687.871091:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823687.871299:0:14298:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793516f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787823687.871512:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651896320 00000100:00100000:0.0:1787823687.871518:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651896320 00000100:00100000:0.0:1787823687.871547:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787823687.871555:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79182b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+11:14298:x1874668651896320:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787823687.871999:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79182b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+11:14298:x1874668651896320:12345-0@lo:501:mount.lustre.0 Request processed in 444us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823687.872007:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787823687.872134:0:14298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14298:1874668651896320:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787823687.872174:0:14298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14298:1874668651896448:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787823687.872217:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823687.872246:0:14298:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793516f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787823687.872292:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651896448 00000100:00100000:0.0:1787823687.872296:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651896448 00000100:00100000:0.0:1787823687.872316:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787823687.872323:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79182bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+11:14298:x1874668651896448:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787823687.872468:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79182bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+11:14298:x1874668651896448:12345-0@lo:503:mount.lustre.0 Request processed in 145us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823687.872475:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787823687.872544:0:14298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14298:1874668651896448:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787823687.872960:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14342:1874668651896576:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787823687.873009:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823687.873031:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793516fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787823687.873070:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651896576 00000100:00100000:0.0:1787823687.873075:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651896576 00000100:00100000:0.0:1787823687.873115:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787823687.873123:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79182bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+11:14342:x1874668651896576:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787823687.873318:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79182bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+11:14342:x1874668651896576:12345-0@lo:502:llog_process_th.0 Request processed in 196us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823687.873326:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787823687.873398:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14342:1874668651896576:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787823687.873422:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787823687.873431:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787823687.873434:0:14342:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787823687.873441:0:14342:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e79358bc000 00000020:00000080:1.0:1787823687.873445:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787823687.873453:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787823687.873456:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787823687.873457:0:14342:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787823687.873459:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787823687.873462:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787823687.873469:0:14342:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787823687.873474:0:14342:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e79358bc000 00000020:00000080:1.0:1787823687.873476:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787823687.873533:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787823687.873536:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787823687.873537:0:14342:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787823687.873540:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787823687.873543:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787823687.873544:0:14342:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787823687.873547:0:14342:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e79358bc000 00000020:00000080:1.0:1787823687.873549:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787823687.873581:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14342:1874668651896704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787823687.873614:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823687.873636:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793516fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787823687.873696:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651896704 00000100:00100000:3.0:1787823687.873701:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651896704 00000100:00100000:3.0:1787823687.873721:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787823687.873729:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79182b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+11:14342:x1874668651896704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787823687.873901:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79182b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+11:14342:x1874668651896704:12345-0@lo:502:llog_process_th.0 Request processed in 173us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823687.873908:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787823687.873946:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14342:1874668651896704:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787823687.873970:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787823687.873974:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787823687.873975:0:14342:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787823687.873980:0:14342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787823687.874234:0:14298:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787823687.874249:0:14298:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787823687.874262:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7920eeaa00/0x5d1142b8324827b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324827bf expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823687.874272:0:14298:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e7920eeaa00/0x5d1142b8324827b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324827bf expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787823687.874310:0:14298:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787823687.874313:0:14298:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e79358bc000 10000000:01000000:0.0:1787823687.874315:0:14298:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e79358bc000 10000000:01000000:0.0:1787823687.874319:0:14298:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787823687.874324:0:14298:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e79358bc000 from 1 10000000:01000000:0.0:1787823687.874327:0:14298:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787823687.874353:0:14298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a40e000/0x5d1142b8324827c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823687.874361:0:14298:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e793a40e000/0x5d1142b8324827c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823687.874369:0:14298:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e793a40e000/0x5d1142b8324827c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823687.874383:0:14298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7802e10f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14298:1874668651896832:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787823687.874424:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823687.874455:0:14298:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e792e727d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787823687.874547:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651896832 00000100:00100000:3.0:1787823687.874552:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651896832 00000100:00100000:3.0:1787823687.874582:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787823687.874590:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79182b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+11:14298:x1874668651896832:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787823687.874600:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823687.874612:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e793a26c200/0x5d1142b8324827cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b8324827c6 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823687.874634:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e793a26c200/0x5d1142b8324827cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b8324827c6 expref: 12 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823687.874645:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e793a26c200/0x5d1142b8324827cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b8324827c6 expref: 12 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823687.874654:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a26c200, rc 0) 00000100:00100000:3.0:1787823687.874696:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79182b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+12:14298:x1874668651896832:12345-0@lo:101:mount.lustre.0 Request processed in 106us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823687.874702:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787823687.874795:0:14298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7802e10f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14298:1874668651896832:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787823687.874809:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e793a40e000/0x5d1142b8324827c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324827cd expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823687.874817:0:14298:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e793a40e000/0x5d1142b8324827c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b8324827cd expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823687.874857:0:14298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14298:1874668651896960:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787823687.874884:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823687.874905:0:14298:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793516f900 going to sleep for 11 seconds 00000100:00100000:3.0:1787823687.874971:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651896960 00000100:00100000:3.0:1787823687.874975:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651896960 00000100:00100000:3.0:1787823687.875004:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787823687.875011:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79182b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+12:14298:x1874668651896960:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787823687.875241:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79182b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+12:14298:x1874668651896960:12345-0@lo:501:mount.lustre.0 Request processed in 230us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823687.875257:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787823687.875333:0:14298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14298:1874668651896960:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787823687.875362:0:14298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14298:1874668651897088:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787823687.875397:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823687.875422:0:14298:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793516f900 going to sleep for 11 seconds 00000100:00100000:3.0:1787823687.875475:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651897088 00000100:00100000:3.0:1787823687.875480:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651897088 00000100:00100000:3.0:1787823687.875498:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787823687.875504:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79182b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+12:14298:x1874668651897088:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787823687.875691:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79182b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+12:14298:x1874668651897088:12345-0@lo:503:mount.lustre.0 Request processed in 186us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823687.875698:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787823687.879099:0:14298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14298:1874668651897088:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787823687.893665:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea8ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14347:1874668651897216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787823687.893783:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823687.893826:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651897216 00000100:00100000:3.0:1787823687.893833:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651897216 00000100:00100000:3.0:1787823687.893875:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787823687.893884:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a45c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+12:14347:x1874668651897216:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787823687.894161:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a45c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+12:14347:x1874668651897216:12345-0@lo:502:llog_process_th.0 Request processed in 277us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823687.894170:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787823687.894224:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79186720c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787823687.894251:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea8ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14347:1874668651897216:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1787823687.894320:0:14347:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787823687.894339:0:14347:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8e7939cbcd70) 00000020:00000080:3.0:1787823687.894374:0:14347:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1787823687.894472:0:14347:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e79358bc000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787823687.894477:0:14347:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e79358bc000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787823687.894480:0:14347:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e79358bc000 4 00010000:00080000:3.0:1787823687.894521:0:14347:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e7935113000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.135@tcp at head 00010000:00010000:3.0:1787823687.896262:0:14347:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1787823687.906749:0:14347:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787823687.906824:0:14347:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787823687.906838:0:14347:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5d1142b8324827db 00000100:00080000:3.0:1787823687.906850:0:14347:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787823687.906857:0:14347:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8e7935113000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:3.0:1787823687.906895:0:14347:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e792ea8ed00 x1874668651897344/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787823687.907008:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874668651897344:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787823687.907094:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823687.907903:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651897344 00000100:00100000:0.0:1787823687.907912:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651897344 00000100:00100000:0.0:1787823687.907946:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787823687.907955:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1874668651897344:12345-0@lo:38:llog_process_th.0 00000100:00080000:3.0:1787823687.909195:0:14347:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787823687.911907:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1874668651897344:12345-0@lo:38:llog_process_th.0 Request processed in 3942us (4802us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787823687.911925:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787823687.912248:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787823687.912258:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8e7935113000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787823687.912263:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787823687.912276:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874668651897344:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787823687.912524:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea8c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14347:1874668651897472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787823687.912597:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823687.912635:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79037cd240 going to sleep for 11 seconds 00000100:00100000:0.0:1787823687.912688:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651897472 00000100:00100000:0.0:1787823687.912694:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651897472 00000100:00100000:0.0:1787823687.912745:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787823687.912755:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a45ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+12:14347:x1874668651897472:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787823687.913051:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a45ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+12:14347:x1874668651897472:12345-0@lo:502:llog_process_th.0 Request processed in 296us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823687.913059:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787823687.913105:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea8c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14347:1874668651897472:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787823687.913130:0:14347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787823687.913279:0:14298:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787823687.913297:0:14298:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787823687.913321:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a40e000/0x5d1142b8324827c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324827cd expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823687.913332:0:14298:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e793a40e000/0x5d1142b8324827c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324827cd expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787823687.913376:0:14298:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787823687.913378:0:14298:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787823687.913379:0:14298:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787823687.913380:0:14298:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787823687.913382:0:14298:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787823687.913383:0:14298:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787823687.913385:0:14298:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787823687.913386:0:14298:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787823687.913388:0:14298:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787823687.913389:0:14298:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787823687.913396:0:14298:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1787823687.913398:0:14298:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787823687.913399:0:14298:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787823687.913400:0:14298:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787823687.913401:0:14298:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787823687.913402:0:14298:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787823687.913403:0:14298:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787823687.913404:0:14298:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787823687.913404:0:14298:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787823687.913405:0:14298:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787823687.913406:0:14298:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787823687.913419:0:14298:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787823687.913429:0:14298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea8da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14298:1874668651897600:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787823687.913459:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823687.913480:0:14298:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79186720c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787823687.913496:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651897600 00000100:00100000:3.0:1787823687.913500:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651897600 00000100:00100000:3.0:1787823687.913526:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787823687.913533:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a45d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+12:14298:x1874668651897600:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787823687.913555:0:14309:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787823687.913569:0:14309:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787823687.955741:0:14309:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787823687.955877:0:14309:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787823687.961646:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a45d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+12:14298:x1874668651897600:12345-0@lo:253:mount.lustre.0 Request processed in 48103us (48176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823687.961667:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 20000000:01000000:0.0:1787823687.961808:0:14332:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787823687.961813:0:14332:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787823687.961836:0:14332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e793a40f000/0x5d1142b8324827e2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823687.961851:0:14332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e793a26ce00/0x5d1142b8324827b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b8324827aa expref: 11 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823687.961860:0:14332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e793a40f000/0x5d1142b8324827e2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823687.961914:0:14332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e793a26ce00/0x5d1142b8324827b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d1142b8324827aa expref: 11 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823687.961939:0:14332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e793a26ce00/0x5d1142b8324827b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d1142b8324827aa expref: 11 pid: 14310 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823687.961955:0:14332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7802e10f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14332:1874668651897728:0@lo:104: 00000100:00100000:0.0:1787823687.962006:0:14332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823687.962038:0:14332:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7904995600 going to sleep for 11 seconds 00000100:00100000:2.0:1787823687.962399:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651897728 00000100:00100000:2.0:1787823687.962410:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651897728 00000100:00100000:2.0:1787823687.962498:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787823687.962508:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7802e11680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+3:14332:x1874668651897728:12345-0@lo:104: 00010000:00010000:2.0:1787823687.962521:0:14299:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff8e7920eea600/0x5d1142b8324827aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b8324827b1 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823687.962583:0:14299:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787823687.962589:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7802e11680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+3:14332:x1874668651897728:12345-0@lo:104: Request processed in 84us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823687.962597:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787823687.962714:0:14332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7802e10f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14332:1874668651897728:0@lo:104: 00010000:00010000:0.0:1787823687.962734:0:14332:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e793a40f000/0x5d1142b8324827e2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823687.962878:0:14298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea8da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14298:1874668651897600:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787823687.962891:0:14298:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787823687.962895:0:14298:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787823687.962896:0:14298:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787823687.962898:0:14298:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787823687.962898:0:14298:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787823687.962899:0:14298:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787823687.962901:0:14298:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787823687.962902:0:14298:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787823687.962904:0:14298:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787823687.962906:0:14298:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787823687.962916:0:14298:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787823687.962942:0:14298:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1787823687.965315:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787823687.965334:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e7920eea600/0x5d1142b8324827aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b8324827b1 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823687.965348:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eea600 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:2.0:1787823687.965354:0:14305:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e7920eea600/0x5d1142b8324827aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d1142b8324827b1 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823687.965366:0:14305:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e7920eea600/0x5d1142b8324827aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d1142b8324827b1 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787823687.965375:0:14305:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e7920eea600/0x5d1142b8324827aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d1142b8324827b1 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787823687.965382:0:14305:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787823687.965562:0:14305:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e7920eea600/0x5d1142b8324827aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b8324827b1 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823687.965588:0:14305:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787823687.965628:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e7920eea600/0x5d1142b8324827aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b8324827b1 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823687.965636:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e7920eea600/0x5d1142b8324827aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b8324827b1 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823687.965656:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823687.965658:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823687.965660:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787823687.965696:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787823687.965717:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b00b7bac-c389-4a58-8ac8-b4f04764fb77:3306:1874668651897856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787823687.965827:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823687.965894:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651897856 00000100:00100000:2.0:1787823687.965901:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651897856 00010000:00010000:2.0:1787823687.967306:0:14301:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e793a26ce00/0x5d1142b8324827b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b8324827aa expref: 12 pid: 14310 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823687.967368:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787823687.967387:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a283840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+12:3306:x1874668651897856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787823687.967407:0:14301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787823687.967540:0:14301:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e793a26ce00/0x5d1142b8324827b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b8324827aa expref: 12 pid: 14310 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823687.967555:0:14301:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e793a26ce00/0x5d1142b8324827b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d1142b8324827aa expref: 12 pid: 14310 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823687.967576:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e793a26ce00/0x5d1142b8324827b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d1142b8324827aa expref: 12 pid: 14310 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823687.967612:0:14301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e793a40f000/0x5d1142b8324827e2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823687.967621:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e793a40f000/0x5d1142b8324827e2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787823687.967639:0:14301:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005826509s 00010000:00010000:2.0:1787823687.967644:0:14301:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e793a40f000/0x5d1142b8324827e2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823687.967650:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e793a40f000/0x5d1142b8324827e2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823687.967657:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e793a40f000/0x5d1142b8324827e2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823687.967663:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e793a40f000/0x5d1142b8324827e2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823687.967668:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40f000 already unused, calling callback (ffffffffc1649440) 00010000:00010000:2.0:1787823687.967672:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e793a40f000/0x5d1142b8324827e2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823687.967679:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e793a40f000/0x5d1142b8324827e2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823687.967701:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e793a40f000/0x5d1142b8324827e2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823687.967712:0:14301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787823687.968197:0:14332:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e793a40f000/0x5d1142b8324827e2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823687.968209:0:14332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e793a40f000/0x5d1142b8324827e2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823687.968215:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e793a40f000/0x5d1142b8324827e2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823687.968390:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a283840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+11:3306:x1874668651897856:12345-0@lo:103:ldlm_bl.0 Request processed in 1011us (2561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823687.968401:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00080000:10000000:3.0:1787823687.972507:0:14298:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1787823687.972689:0:14298:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00000100:00100000:0.0:1787823687.973285:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b00b7bac-c389-4a58-8ac8-b4f04764fb77:3306:1874668651897856:0@lo:103:ldlm_bl.0 00080000:10000000:3.0:1787823687.973505:0:14298:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1787823687.973679:0:14298:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787823687.974265:0:14298:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1787823687.974497:0:14298:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1787823687.975643:0:14298:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1787823687.976225:0:14298:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1787823687.976601:0:14298:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1787823687.977374:0:14298:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1787823687.978021:0:14298:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1787823687.978264:0:14298:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1787823688.037842:0:14298:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1787823688.039809:0:14298:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1787823688.040112:0:14354:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1787823688.040116:0:14354:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1787823688.046410:0:14355:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1787823688.046553:0:14355:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1787823688.055674:0:14298:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787823688.055893:0:14298:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787823688.057296:0:14355:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787823688.057381:0:14355:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787823688.057385:0:14355:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00000080:2.0:1787823688.057741:0:14298:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787823688.057779:0:14298:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787823688.058050:0:14298:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787823688.059030:0:14298:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787823688.059540:0:14298:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787823688.059569:0:14298:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1787823688.068455:0:14298:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1787823688.075571:0:14298:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1787823688.113088:0:14298:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787823688.113141:0:14298:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa52500d53988 00100000:10000000:3.0:1787823688.113151:0:14298:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787823688.114012:0:14298:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787823688.114026:0:14298:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.135@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787823688.114039:0:14298:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1787823688.114057:0:14298:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1787823688.556816:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787823688.873844:0:14313:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787823688.873851:0:14313:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e79358bc000 from 6 10000000:01000000:0.0:1787823688.873862:0:14313:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787823688.873906:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a40ea00/0x5d1142b8324827e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823688.873918:0:14313:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e793a40ea00/0x5d1142b8324827e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823688.873932:0:14313:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e793a40ea00/0x5d1142b8324827e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823688.873958:0:14313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7802e10000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14313:1874668651897984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787823688.874041:0:14313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823688.874091:0:14313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7904995c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787823688.874114:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651897984 00000100:00100000:0.0:1787823688.874121:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651897984 00000100:00100000:0.0:1787823688.874173:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787823688.874182:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a45c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+11:14313:x1874668651897984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787823688.874197:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823688.874212:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e793a40e800/0x5d1142b8324827f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b8324827e9 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823688.874236:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e793a40e800/0x5d1142b8324827f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b8324827e9 expref: 12 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823688.874247:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e793a40e800/0x5d1142b8324827f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b8324827e9 expref: 12 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823688.874257:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40e800, rc 0) 00000100:00100000:0.0:1787823688.874297:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a45c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+12:14313:x1874668651897984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823688.874313:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787823688.874380:0:14313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7802e10000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14313:1874668651897984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787823688.874395:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e793a40ea00/0x5d1142b8324827e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324827f0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823688.874404:0:14313:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e793a40ea00/0x5d1142b8324827e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b8324827f0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823688.874451:0:14313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7802e10000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14313:1874668651898112:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787823688.874479:0:14313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823688.874497:0:14313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7904995c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787823688.874511:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651898112 00000100:00100000:0.0:1787823688.874514:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651898112 00000100:00100000:0.0:1787823688.874537:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787823688.874545:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a45e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+12:14313:x1874668651898112:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787823688.874561:0:14309:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787823688.874581:0:14309:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787823688.874585:0:14309:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1787823688.874658:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a45e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+12:14313:x1874668651898112:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 113us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823688.874666:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787823688.874694:0:14313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7802e10000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14313:1874668651898112:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787823688.874729:0:14313:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787823688.874736:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a40ea00/0x5d1142b8324827e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324827f0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823688.874753:0:14313:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e793a40ea00/0x5d1142b8324827e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324827f0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787823688.940091:0:14348:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787823689.578213:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787823689.976714:0:14348:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787823690.603060:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823691.627556:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787823692.193310:0:14597:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg235-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787823692.650314:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787823693.292320:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b00b7bac-c389-4a58-8ac8-b4f04764fb77:3306:1874668651898240:0@lo:400:kworker.0 00000100:00100000:2.0:1787823693.292402:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787823693.292435:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787823693.292441:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787823693.292444:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787823693.292447:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787823693.292450:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787823693.292453:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787823693.292461:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e7935113000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787823693.292473:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8e7935113000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:1.0:1787823693.292503:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e7922a0e1c0 x1874668651898368/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787823693.293392:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874668651898368:0@lo:38:kworker.0 00000100:00100000:3.0:1787823693.293451:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823693.299541:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651898240 00000100:00100000:0.0:1787823693.299555:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651898240 00000100:00100000:0.0:1787823693.299616:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787823693.299625:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a45f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+12:3306:x1874668651898240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823693.302872:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651898368 00000100:00100000:1.0:1787823693.302889:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651898368 00000100:00100000:1.0:1787823693.302948:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787823693.302958:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3304:x1874668651898368:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787823693.302994:0:14317:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 434 last 0 00000020:00000080:1.0:1787823693.303038:0:14317:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5d1142b8324827f7 00000100:00100000:0.0:1787823693.304325:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a45f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+12:3306:x1874668651898240:12345-0@lo:400:kworker.0 Request processed in 4694us (11916us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823693.304342:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787823693.304389:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b00b7bac-c389-4a58-8ac8-b4f04764fb77:3306:1874668651898240:0@lo:400:kworker.0 00000004:00100000:3.0:1787823693.310217:0:14317:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787823693.310385:0:14317:0:(import.c:65:import_set_state_nolock()) ffff8e7909869000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787823693.310555:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874668651898368:12345-0@lo:38:kworker.0 Request processed in 7595us (17100us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823693.310573:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787823693.311655:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e7922a0e1c0 x1874668651898368/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787823703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787823693.311676:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787823693.311684:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787823693.311689:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787823693.311692:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8e7935113000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787823693.311698:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874668651898368:0@lo:38:kworker.0 00010000:00010000:2.0:1787823693.676240:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823694.699374:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823695.722200:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787823695.871749:0:14748:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc401f3e70 20000000:00000080:3.0:1787823695.872409:0:14748:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e7936f74000 uarg=0000000000000000 20000000:01000000:3.0:1787823695.872551:0:14748:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787823695.872558:0:14748:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787823695.872562:0:14748:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787823695.873705:0:14749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1787823695.874210:0:14748:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787823695.884242:0:14748:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787823695.884347:0:14748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e793a26ce00/0x5d1142b8324827fe lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823695.884368:0:14748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e793a26d400/0x5d1142b8324827bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b8324827b8 expref: 11 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823695.884378:0:14748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e793a26ce00/0x5d1142b8324827fe lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823695.884422:0:14748:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e793a26d400/0x5d1142b8324827bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d1142b8324827b8 expref: 11 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823695.884438:0:14748:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e793a26d400/0x5d1142b8324827bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d1142b8324827b8 expref: 11 pid: 14311 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823695.884453:0:14748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea8d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14748:1874668651898496:0@lo:104: 00000100:00100000:3.0:1787823695.884525:0:14748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823695.884654:0:14748:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a47a840 going to sleep for 11 seconds 00000100:00100000:2.0:1787823695.885429:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651898496 00000100:00100000:2.0:1787823695.885438:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651898496 00000100:00100000:2.0:1787823695.885542:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787823695.885553:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+3:14748:x1874668651898496:12345-0@lo:104: 00010000:00010000:2.0:1787823695.885582:0:14299:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff8e7920eeaa00/0x5d1142b8324827b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b8324827bf expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823695.886177:0:14299:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787823695.886186:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+3:14748:x1874668651898496:12345-0@lo:104: Request processed in 635us (1660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823695.886194:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787823695.886247:0:14748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea8d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14748:1874668651898496:0@lo:104: 00010000:00010000:3.0:1787823695.886279:0:14748:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e793a26ce00/0x5d1142b8324827fe lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823695.886550:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787823695.886558:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e7920eeaa00/0x5d1142b8324827b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b8324827bf expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823695.886566:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eeaa00 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:0.0:1787823695.886570:0:14304:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e7920eeaa00/0x5d1142b8324827b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d1142b8324827bf expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823695.886578:0:14304:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e7920eeaa00/0x5d1142b8324827b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d1142b8324827bf expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787823695.886585:0:14304:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e7920eeaa00/0x5d1142b8324827b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d1142b8324827bf expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787823695.886590:0:14304:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787823695.889436:0:14304:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e7920eeaa00/0x5d1142b8324827b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b8324827bf expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823695.889456:0:14304:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787823695.889500:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e7920eeaa00/0x5d1142b8324827b8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b8324827bf expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823695.889509:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e7920eeaa00/0x5d1142b8324827b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b8324827bf expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823695.889537:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823695.889540:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823695.889543:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823695.889687:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b00b7bac-c389-4a58-8ac8-b4f04764fb77:3307:1874668651898624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787823695.889782:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823695.889939:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651898624 00000100:00100000:1.0:1787823695.889946:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651898624 00010000:00010000:1.0:1787823695.889974:0:14302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e793a26d400/0x5d1142b8324827bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b8324827b8 expref: 12 pid: 14311 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823695.890009:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787823695.890018:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7802e12580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+12:3307:x1874668651898624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787823695.890031:0:14302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823695.890043:0:14302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e793a26d400/0x5d1142b8324827bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b8324827b8 expref: 12 pid: 14311 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823695.890055:0:14302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e793a26d400/0x5d1142b8324827bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d1142b8324827b8 expref: 12 pid: 14311 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823695.890082:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e793a26d400/0x5d1142b8324827bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d1142b8324827b8 expref: 12 pid: 14311 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823695.890099:0:14302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e793a26ce00/0x5d1142b8324827fe lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823695.890108:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e793a26ce00/0x5d1142b8324827fe lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823695.890125:0:14302:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e793a26ce00/0x5d1142b8324827fe lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823695.890133:0:14302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e793a26ce00/0x5d1142b8324827fe lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823695.890139:0:14302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e793a26ce00/0x5d1142b8324827fe lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823695.890147:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e793a26ce00/0x5d1142b8324827fe lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823695.890154:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26ce00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:1.0:1787823695.890157:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e793a26ce00/0x5d1142b8324827fe lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823695.890166:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e793a26ce00/0x5d1142b8324827fe lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823695.890188:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e793a26ce00/0x5d1142b8324827fe lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823695.890199:0:14302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823695.890239:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7802e12580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+11:3307:x1874668651898624:12345-0@lo:103:ldlm_bl.0 Request processed in 221us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823695.890247:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787823695.890303:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b00b7bac-c389-4a58-8ac8-b4f04764fb77:3307:1874668651898624:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787823695.890874:0:14748:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e793a26ce00/0x5d1142b8324827fe lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823695.890885:0:14748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e793a26ce00/0x5d1142b8324827fe lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823695.890892:0:14748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e793a26ce00/0x5d1142b8324827fe lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823696.746769:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787823697.259549:0:14313:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787823697.259556:0:14313:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e79358bc000 from 10 10000000:01000000:3.0:1787823697.259559:0:14313:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787823697.259601:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a26c600/0x5d1142b832482805 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823697.259610:0:14313:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e793a26c600/0x5d1142b832482805 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823697.259619:0:14313:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e793a26c600/0x5d1142b832482805 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823697.259642:0:14313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea8da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14313:1874668651898752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787823697.259710:0:14313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823697.259782:0:14313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7909ac2000 going to sleep for 11 seconds 00000100:00100000:0.0:1787823697.259782:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651898752 00000100:00100000:0.0:1787823697.259790:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651898752 00000100:00100000:0.0:1787823697.259848:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787823697.259858:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a45f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+11:14313:x1874668651898752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787823697.259880:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823697.259896:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e793a40ee00/0x5d1142b83248280c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b832482805 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823697.259931:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e793a40ee00/0x5d1142b83248280c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b832482805 expref: 12 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823697.259942:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e793a40ee00/0x5d1142b83248280c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832482805 expref: 12 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823697.259951:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40ee00, rc 0) 00000100:00100000:0.0:1787823697.260059:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a45f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+12:14313:x1874668651898752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 201us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823697.260066:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787823697.260613:0:14313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea8da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14313:1874668651898752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787823697.260637:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e793a26c600/0x5d1142b832482805 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248280c expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823697.260645:0:14313:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e793a26c600/0x5d1142b832482805 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b83248280c expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823697.260703:0:14313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea8da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14313:1874668651898880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787823697.260731:0:14313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823697.260894:0:14313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7909ac2000 going to sleep for 11 seconds 00000100:00100000:0.0:1787823697.261039:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651898880 00000100:00100000:0.0:1787823697.261099:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651898880 00000100:00100000:0.0:1787823697.261172:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787823697.261180:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a45f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+12:14313:x1874668651898880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787823697.261614:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a45f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+12:14313:x1874668651898880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 433us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823697.261630:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787823697.262008:0:14313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea8da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14313:1874668651898880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787823697.262063:0:14313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14313:1874668651899008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787823697.262109:0:14313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823697.262497:0:14313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908ff4240 going to sleep for 11 seconds 00000100:00100000:3.0:1787823697.262538:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651899008 00000100:00100000:3.0:1787823697.262543:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651899008 00000100:00100000:3.0:1787823697.262579:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787823697.262586:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a45fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+12:14313:x1874668651899008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787823697.262793:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a45fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+12:14313:x1874668651899008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 207us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823697.262800:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787823697.263463:0:14313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14313:1874668651899008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787823697.281987:0:14801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787823697.282531:0:14313:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787823697.282562:0:14313:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787823697.282574:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a26c600/0x5d1142b832482805 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248280c expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823697.282587:0:14313:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e793a26c600/0x5d1142b832482805 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248280c expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823697.385894:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787823687/real 1787823687] req@ffff8e7802e13480 x1874668651895680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787823697 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787823697.385947:0:3304:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e7802e13480 x1874668651895680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787823697 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787823697.385959:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787823687/real 1787823687] req@ffff8e7802e10780 x1874668651895552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787823697 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787823697.385971:0:3304:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e7802e10780 x1874668651895552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787823697 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787823697.385991:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8e7918291800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787823697.386030:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787823697.386034:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7802e13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874668651895680:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787823697.386040:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8e79358ef000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787823697.386045:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787823697.386049:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7802e10780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874668651895552:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787823697.386075:0:12985:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787823697.386082:0:12985:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787823697.386086:0:12985:0:(import.c:65:import_set_state_nolock()) ffff8e79358ef000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787823697.386092:0:12985:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 428 00000100:00080000:0.0:1787823697.386099:0:12985:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787823697.386106:0:12985:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e79358ef000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:0.0:1787823697.386141:0:12985:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e7802e10b40 x1874668651899136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787823697.386166:0:12985:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787823697.386169:0:12985:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787823697.386171:0:12985:0:(import.c:65:import_set_state_nolock()) ffff8e7918291800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787823697.386175:0:12985:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 428 00000100:00080000:0.0:1787823697.386179:0:12985:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787823697.386183:0:12985:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e7918291800 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:0.0:1787823697.386209:0:12985:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e7802e12d00 x1874668651899264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787823697.386529:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7802e112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874668651899392:0@lo:400:kworker.0 00000100:00100000:3.0:1787823697.386598:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823697.386672:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651899392 00000100:00100000:3.0:1787823697.386680:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651899392 00000100:00100000:3.0:1787823697.386739:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787823697.386749:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874668651899392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823697.386824:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874668651899392:12345-0@lo:400:kworker.0 Request processed in 76us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823697.386832:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787823697.386870:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e7802e112c0 x1874668651899392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787823713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823697.386883:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7802e112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874668651899392:0@lo:400:kworker.0 00000100:00100000:1.0:1787823697.386977:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7802e10b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874668651899136:0@lo:8:kworker.0 00000400:00000100:1.0:1787823697.387006:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874668651899136 offset 0 length 520: 4 00000100:00100000:1.0:1787823697.387025:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7802e12d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874668651899264:0@lo:8:kworker.0 00000400:00000100:1.0:1787823697.387041:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874668651899264 offset 0 length 520: 4 00010000:00010000:1.0:1787823697.770868:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823698.801810:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787823699.179459:0:14348:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787823699.824666:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823700.842971:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787823700.950908:0:14997:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787823700.950913:0:14997:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787823700.951030:0:14997:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e79187b1000 00000020:01000004:2.0:1787823700.951045:0:14997:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787823700.951058:0:14997:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787823700.951072:0:14997:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8e7906f4cd70) 00000020:00000080:2.0:1787823700.951089:0:14997:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787823700.988993:0:14997:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787823700.990226:0:14997:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787823700.994005:0:14997:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787823700.995099:0:14997:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787823700.996787:0:14997:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787823700.999304:0:14997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 531: rc = 0 00100000:10000000:3.0:1787823700.999401:0:14997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 531: rc = 0 00100000:10000000:3.0:1787823700.999473:0:14997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 531: rc = 0 00100000:10000000:3.0:1787823700.999948:0:14997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 342: rc = 0 00100000:10000000:3.0:1787823701.001436:0:14997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 342: rc = 0 00100000:10000000:3.0:1787823701.001993:0:14997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 342: rc = 0 00100000:10000000:3.0:1787823701.002645:0:14997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 342: rc = 0 00100000:10000000:3.0:1787823701.002957:0:14997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 342: rc = 0 00100000:10000000:3.0:1787823701.006942:0:14997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 342: rc = 0 00000020:00000080:3.0:1787823701.008580:0:14997:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787823701.008598:0:14997:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787823701.008610:0:14997:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5d1142b83248281a 00000020:01000004:3.0:1787823701.008619:0:14997:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1787823701.008648:0:14997:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.135@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787823701.008659:0:14997:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.135@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787823701.008668:0:14997:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787823701.008673:0:14997:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787823701.008705:0:14997:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8e7936a38000) 00000020:00000080:3.0:1787823701.008717:0:14997:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1787823701.020210:0:14997:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787823701.020419:0:14997:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787823701.020426:0:14997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787823701.029490:0:14997:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787823701.029506:0:14997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787823701.032007:0:14997:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787823701.032018:0:14997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787823701.033956:0:14997:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787823701.034210:0:14997:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787823701.034216:0:14997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787823701.035197:0:14997:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787823701.035205:0:14997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787823701.052186:0:14997:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787823701.052448:0:14997:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787823701.052454:0:14997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787823701.053995:0:14997:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787823701.054006:0:14997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787823701.057551:0:14997:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787823701.057566:0:14997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787823701.064927:0:14997:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787823701.068992:0:14997:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787823701.069009:0:14997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787823701.069602:0:14997:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787823701.069610:0:14997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1787823701.131487:0:14997:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787823701.131990:0:14997:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787823701.131998:0:14997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787823701.133279:0:14997:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787823701.133290:0:14997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787823701.133912:0:14997:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787823701.133938:0:14997:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1787823701.133944:0:14997:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.135@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787823701.149405:0:14997:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.135@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787823701.149459:0:14997:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.135@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1787823701.149464:0:14997:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787823701.149465:0:14997:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787823701.149466:0:14997:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787823701.149468:0:14997:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787823701.149469:0:14997:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787823701.149470:0:14997:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787823701.149471:0:14997:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787823701.149473:0:14997:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787823701.149474:0:14997:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787823701.149478:0:14997:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1787823701.149480:0:14997:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787823701.149482:0:14997:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787823701.149482:0:14997:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787823701.149484:0:14997:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787823701.149485:0:14997:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787823701.149486:0:14997:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787823701.149487:0:14997:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787823701.149492:0:14997:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787823701.149493:0:14997:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787823701.150042:0:14997:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787823701.150069:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14997:1874668651899520:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787823701.150338:0:14997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823701.150451:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908ff4840 going to sleep for 11 seconds 00000100:00100000:3.0:1787823701.150490:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651899520 00000100:00100000:3.0:1787823701.150498:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651899520 00000100:00100000:3.0:1787823701.150660:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787823701.150671:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a45e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+12:14997:x1874668651899520:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787823701.150700:0:14310:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787823701.150703:0:14310:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1787823701.150708:0:14310:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787823701.171652:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a45e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+12:14997:x1874668651899520:12345-0@lo:253:mount.lustre.0 Request processed in 20973us (21305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823701.171667:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787823701.171918:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14997:1874668651899520:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787823701.171934:0:14997:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787823701.171937:0:14997:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787823701.171939:0:14997:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787823701.171940:0:14997:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787823701.171941:0:14997:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787823701.171942:0:14997:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787823701.171943:0:14997:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787823701.171945:0:14997:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787823701.171947:0:14997:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787823701.171948:0:14997:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787823701.171967:0:14997:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e79187b1000 from lustre-OST0000 10000000:01000000:1.0:1787823701.171994:0:14997:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787823701.171996:0:14997:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787823701.172004:0:14997:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e792ea819d0 local copy 00010000:00010000:1.0:1787823701.172015:0:14997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b832482710 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832482717 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823701.172267:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14997:1874668651899648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787823701.172304:0:14997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823701.172343:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908ff4780 going to sleep for 11 seconds 00000100:00100000:3.0:1787823701.172738:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651899648 00000100:00100000:3.0:1787823701.172754:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651899648 00000100:00100000:3.0:1787823701.172814:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787823701.172823:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a45d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+12:14997:x1874668651899648:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787823701.172990:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a45d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+12:14997:x1874668651899648:12345-0@lo:501:mount.lustre.0 Request processed in 167us (685us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787823701.172997:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787823701.175281:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14997:1874668651899648:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787823701.175306:0:14997:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.135@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787823701.175525:0:14997:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.135@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787823701.175535:0:14997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b832482710 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832482717 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823701.175554:0:14997:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b832482710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832482717 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787823701.175605:0:14997:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e79187b1000 10000000:01000000:1.0:1787823701.175610:0:14997:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787823701.175615:0:14997:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8e792ea819d0 10000000:01000000:1.0:1787823701.175618:0:14997:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787823701.175621:0:14997:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8e792ea819d0 from 1 10000000:01000000:1.0:1787823701.175624:0:14997:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787823701.175657:0:14997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7920eea400/0x5d1142b832482828 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823701.175665:0:14997:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e7920eea400/0x5d1142b832482828 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823701.175675:0:14997:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e7920eea400/0x5d1142b832482828 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823701.175694:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14997:1874668651899776:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787823701.175749:0:14997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823701.176126:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908ff4780 going to sleep for 11 seconds 00000100:00100000:3.0:1787823701.176243:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651899776 00000100:00100000:3.0:1787823701.176250:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651899776 00000100:00100000:3.0:1787823701.176300:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787823701.176310:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a45cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+12:14997:x1874668651899776:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787823701.176324:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823701.176339:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e793a26d200/0x5d1142b83248282f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b832482828 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823701.176373:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e793a26d200/0x5d1142b83248282f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b832482828 expref: 13 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823701.176384:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e793a26d200/0x5d1142b83248282f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832482828 expref: 13 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823701.176395:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a26d200, rc 0) 00000100:00100000:3.0:1787823701.176442:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a45cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+13:14997:x1874668651899776:12345-0@lo:101:mount.lustre.0 Request processed in 134us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823701.176449:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787823701.176533:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14997:1874668651899776:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787823701.176546:0:14997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e7920eea400/0x5d1142b832482828 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248282f expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823701.176574:0:14997:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e7920eea400/0x5d1142b832482828 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b83248282f expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787823701.176600:0:14997:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787823701.176614:0:14997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7920eea400/0x5d1142b832482828 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248282f expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823701.176622:0:14997:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e7920eea400/0x5d1142b832482828 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248282f expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787823701.176628:0:14997:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787823701.176632:0:14997:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787823701.176636:0:14997:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787823701.176638:0:14997:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787823701.176654:0:14997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e79358d2e00/0x5d1142b832482836 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823701.176661:0:14997:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e79358d2e00/0x5d1142b832482836 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823701.176669:0:14997:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e79358d2e00/0x5d1142b832482836 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823701.176685:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a282d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14997:1874668651899904:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787823701.176714:0:14997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823701.176736:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7901254000 going to sleep for 11 seconds 00000100:00100000:0.0:1787823701.176846:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651899904 00000100:00100000:0.0:1787823701.176851:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651899904 00000100:00100000:0.0:1787823701.176898:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787823701.176906:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a45c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+13:14997:x1874668651899904:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787823701.176914:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823701.176924:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e793a40e600/0x5d1142b83248283d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b832482836 expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823701.176939:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e793a40e600/0x5d1142b83248283d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b832482836 expref: 14 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823701.176947:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e793a40e600/0x5d1142b83248283d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832482836 expref: 14 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823701.176954:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40e600, rc 0) 00000100:00100000:0.0:1787823701.176985:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a45c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+14:14997:x1874668651899904:12345-0@lo:101:mount.lustre.0 Request processed in 81us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823701.176990:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787823701.177261:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a282d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14997:1874668651899904:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787823701.177273:0:14997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e79358d2e00/0x5d1142b832482836 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248283d expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823701.177289:0:14997:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e79358d2e00/0x5d1142b832482836 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b83248283d expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787823701.178057:0:14997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787823701.180504:0:14997:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787823701.180861:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787823701.180930:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787823701.180963:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787823701.183067:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787823701.183408:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787823701.183445:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787823701.183533:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787823701.183541:0:14997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787823701.183999:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a282d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14997:1874668651900032:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787823701.185265:0:14997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823701.185315:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79012546c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787823701.185685:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651900032 00000100:00100000:1.0:1787823701.185693:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651900032 00000100:00100000:1.0:1787823701.185774:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787823701.185785:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793510c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+14:14997:x1874668651900032:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787823701.192082:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793510c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+14:14997:x1874668651900032:12345-0@lo:501:mount.lustre.0 Request processed in 6291us (6811us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823701.192097:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787823701.192622:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a282d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14997:1874668651900032:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787823701.193008:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea8c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14997:1874668651900160:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787823701.193202:0:14997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823701.193242:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7903ca7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787823701.193305:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651900160 00000100:00100000:1.0:1787823701.193311:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651900160 00000100:00100000:1.0:1787823701.193495:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787823701.193505:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793510ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+14:14997:x1874668651900160:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787823701.194276:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793510ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+14:14997:x1874668651900160:12345-0@lo:503:mount.lustre.0 Request processed in 770us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823701.194284:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787823701.194466:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea8c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14997:1874668651900160:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787823701.195985:0:14997:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787823701.196242:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea8c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14997:1874668651900288:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787823701.196307:0:14997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823701.196482:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908c15540 going to sleep for 11 seconds 00000100:00100000:1.0:1787823701.196918:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651900288 00000100:00100000:1.0:1787823701.196926:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651900288 00000100:00100000:1.0:1787823701.197018:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787823701.197029:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793510cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+14:14997:x1874668651900288:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787823701.197531:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793510cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+14:14997:x1874668651900288:12345-0@lo:502:mount.lustre.0 Request processed in 298us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823701.197540:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787823701.197659:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea8c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14997:1874668651900288:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787823701.197995:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787823701.198062:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787823701.198122:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787823701.198167:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787823701.198198:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787823701.198225:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787823701.198264:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787823701.198292:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787823701.198319:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1787823701.199080:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1787823701.199190:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1787823701.199238:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1787823701.199283:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a281680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14997:1874668651900416:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787823701.199677:0:14997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823701.199727:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79012546c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787823701.199935:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651900416 00000100:00100000:3.0:1787823701.199944:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651900416 00000100:00100000:3.0:1787823701.199996:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787823701.200006:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793510f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+14:14997:x1874668651900416:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787823701.200712:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793510f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+14:14997:x1874668651900416:12345-0@lo:502:mount.lustre.0 Request processed in 706us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823701.200720:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787823701.200984:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a281680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14997:1874668651900416:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787823701.201291:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1787823701.201308:0:14997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1787823701.216287:0:15012:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787823701.216300:0:15012:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787823701.216306:0:15012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787823701.216309:0:15012:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787823701.216316:0:15012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787823701.220227:0:15012:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8e7936a3cd70) 00000020:00000080:3.0:1787823701.220265:0:15012:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787823701.220289:0:15012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787823701.220412:0:15012:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e79187b1000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787823701.220420:0:15012:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787823701.220428:0:15012:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5d1142b83248284b 00010000:00010000:2.0:1787823701.232404:0:15012:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1787823701.233442:0:15012:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1787823701.238525:0:15012:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1787823701.240378:0:15012:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787823701.240393:0:15012:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787823701.240400:0:15012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787823701.240402:0:15012:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787823701.240407:0:15012:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787823701.240410:0:15012:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1787823701.240411:0:15012:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787823701.240413:0:15012:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787823701.240414:0:15012:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787823701.240416:0:15012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787823701.240417:0:15012:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787823701.240420:0:15012:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787823701.240423:0:15012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787823701.240424:0:15012:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787823701.240427:0:15012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787823701.240429:0:15012:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787823701.240431:0:15012:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787823701.240433:0:15012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787823701.240435:0:15012:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787823701.240437:0:15012:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787823701.240439:0:15012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787823701.240440:0:15012:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787823701.240443:0:15012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787823701.240509:0:15012:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787823701.240513:0:15012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787823701.240514:0:15012:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787823701.240517:0:15012:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1787823701.240887:0:14997:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1787823701.240916:0:14997:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787823701.240942:0:14997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e79358d2e00/0x5d1142b832482836 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248283d expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823701.240954:0:14997:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e79358d2e00/0x5d1142b832482836 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b83248283d expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787823701.240962:0:14997:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e79187b1000 from 1 10000000:01000000:3.0:1787823701.240965:0:14997:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787823701.240998:0:14997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a26de00/0x5d1142b832482852 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823701.241005:0:14997:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e793a26de00/0x5d1142b832482852 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823701.241178:0:14997:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e793a26de00/0x5d1142b832482852 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823701.241215:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea8d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14997:1874668651900544:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787823701.241721:0:14997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823701.241964:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651900544 00000100:00100000:2.0:1787823701.241973:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651900544 00000100:00100000:0.0:1787823701.242088:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787823701.242100:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793510f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+14:14997:x1874668651900544:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787823701.242175:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823701.242189:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e793a40f400/0x5d1142b832482859 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b832482852 expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823701.242213:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e793a40f400/0x5d1142b832482859 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b832482852 expref: 15 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823701.242230:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e793a40f400/0x5d1142b832482859 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832482852 expref: 15 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823701.242238:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40f400, rc 0) 00000100:00100000:0.0:1787823701.242273:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793510f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+15:14997:x1874668651900544:12345-0@lo:101:mount.lustre.0 Request processed in 176us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823701.242279:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787823701.242348:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908c15900 going to sleep for 11 seconds 00000100:00100000:3.0:1787823701.242369:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea8d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14997:1874668651900544:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787823701.242382:0:14997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e793a26de00/0x5d1142b832482852 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832482859 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823701.242390:0:14997:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e793a26de00/0x5d1142b832482852 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b832482859 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787823701.249194:0:14997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787823701.250037:0:14997:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787823701.250446:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787823701.250492:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787823701.250553:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787823701.250562:0:14997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787823701.250659:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a281680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14997:1874668651900672:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787823701.250734:0:14997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823701.250815:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7901254000 going to sleep for 11 seconds 00000100:00100000:1.0:1787823701.251151:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651900672 00000100:00100000:1.0:1787823701.251157:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651900672 00000100:00100000:1.0:1787823701.251213:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787823701.251225:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793510d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+15:14997:x1874668651900672:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787823701.251469:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793510d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+15:14997:x1874668651900672:12345-0@lo:501:mount.lustre.0 Request processed in 246us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823701.251477:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787823701.251631:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a281680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14997:1874668651900672:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787823701.251670:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea8d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14997:1874668651900800:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787823701.251708:0:14997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823701.251730:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908c15900 going to sleep for 11 seconds 00000100:00100000:1.0:1787823701.251833:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651900800 00000100:00100000:1.0:1787823701.251837:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651900800 00000100:00100000:1.0:1787823701.251875:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787823701.251883:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793510dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+15:14997:x1874668651900800:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787823701.252124:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea8d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14997:1874668651900800:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787823701.252593:0:14997:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787823701.252655:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea8d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14997:1874668651900928:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787823701.252694:0:14997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823701.252718:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651900928 00000100:00100000:3.0:1787823701.252722:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651900928 00000100:00100000:3.0:1787823701.252740:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787823701.252746:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793510c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+16:14997:x1874668651900928:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787823701.252897:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793510c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+16:14997:x1874668651900928:12345-0@lo:502:mount.lustre.0 Request processed in 150us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823701.252912:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787823701.252963:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908c15900 going to sleep for 11 seconds 00000100:00100000:3.0:1787823701.252975:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea8d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14997:1874668651900928:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787823701.253637:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793510dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+15:14997:x1874668651900800:12345-0@lo:503:mount.lustre.0 Request processed in 130us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823701.253655:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000040:00080000:3.0:1787823701.253881:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787823701.253934:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787823701.253981:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787823701.255708:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787823701.255814:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787823701.255889:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787823701.255928:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787823701.255957:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1787823701.256004:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea8d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14997:1874668651901056:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787823701.256923:0:14997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823701.256968:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908c15900 going to sleep for 11 seconds 00000100:00100000:2.0:1787823701.257188:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651901056 00000100:00100000:2.0:1787823701.257196:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651901056 00000100:00100000:2.0:1787823701.257247:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787823701.257256:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793510c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+15:14997:x1874668651901056:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787823701.257461:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793510c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+15:14997:x1874668651901056:12345-0@lo:502:mount.lustre.0 Request processed in 206us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823701.257469:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787823701.257649:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea8d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14997:1874668651901056:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787823701.258670:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787823701.258685:0:14997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787823701.261437:0:15016:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787823701.261456:0:15016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787823701.261459:0:15016:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787823701.261470:0:15016:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e79187b1000 00000020:00000080:3.0:1787823701.261473:0:15016:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787823701.261481:0:15016:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787823701.261484:0:15016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787823701.261486:0:15016:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787823701.261489:0:15016:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787823701.261491:0:15016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787823701.261493:0:15016:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787823701.261496:0:15016:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e79187b1000 00000020:00000080:3.0:1787823701.261518:0:15016:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787823701.261582:0:15016:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787823701.261586:0:15016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787823701.261587:0:15016:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787823701.261590:0:15016:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787823701.261593:0:15016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787823701.261594:0:15016:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787823701.261597:0:15016:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e79187b1000 00000020:00000080:3.0:1787823701.261599:0:15016:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787823701.261633:0:15016:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787823701.261635:0:15016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787823701.261637:0:15016:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787823701.261640:0:15016:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1787823701.261847:0:14997:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787823701.261886:0:14997:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787823701.261901:0:14997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a26de00/0x5d1142b832482852 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832482859 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823701.261915:0:14997:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e793a26de00/0x5d1142b832482852 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832482859 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787823701.261966:0:14997:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787823701.261970:0:14997:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e79187b1000 10000000:01000000:2.0:1787823701.261973:0:14997:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e79187b1000 10000000:01000000:2.0:1787823701.261978:0:14997:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787823701.261984:0:14997:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e79187b1000 from 1 10000000:01000000:2.0:1787823701.261986:0:14997:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787823701.262036:0:14997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e79358d2200/0x5d1142b832482860 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823701.262044:0:14997:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e79358d2200/0x5d1142b832482860 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823701.262056:0:14997:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e79358d2200/0x5d1142b832482860 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823701.262082:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a280780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14997:1874668651901184:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787823701.262162:0:14997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823701.262202:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e790afdb540 going to sleep for 11 seconds 00000100:00100000:3.0:1787823701.262364:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651901184 00000100:00100000:3.0:1787823701.262372:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651901184 00000100:00100000:3.0:1787823701.262425:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787823701.262434:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793510e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+15:14997:x1874668651901184:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787823701.262446:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823701.262460:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e793a26da00/0x5d1142b832482867 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b832482860 expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823701.262482:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e793a26da00/0x5d1142b832482867 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b832482860 expref: 16 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823701.262492:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e793a26da00/0x5d1142b832482867 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832482860 expref: 16 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823701.262500:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a26da00, rc 0) 00000100:00100000:3.0:1787823701.262537:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793510e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+16:14997:x1874668651901184:12345-0@lo:101:mount.lustre.0 Request processed in 105us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823701.262544:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787823701.263297:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a280780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14997:1874668651901184:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787823701.263314:0:14997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e79358d2200/0x5d1142b832482860 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832482867 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823701.263497:0:14997:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e79358d2200/0x5d1142b832482860 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b832482867 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787823701.266179:0:14997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1787823701.269995:0:14997:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787823701.270355:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787823701.270400:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787823701.270429:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787823701.270473:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787823701.270504:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787823701.270549:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787823701.270602:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787823701.270636:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787823701.270699:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787823701.270735:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787823701.270791:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787823701.270834:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787823701.270862:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787823701.270922:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787823701.270963:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787823701.270996:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787823701.271027:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787823701.271068:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787823701.271097:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787823701.271125:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787823701.271168:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787823701.271203:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787823701.271234:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787823701.271279:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787823701.271311:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1787823701.271340:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1787823701.271382:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1787823701.271409:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1787823701.271472:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1787823701.271480:0:14997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1787823701.271582:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea8d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14997:1874668651901312:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787823701.271661:0:14997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823701.271708:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908c15c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787823701.277673:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651901312 00000100:00100000:2.0:1787823701.277690:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651901312 00000100:00100000:2.0:1787823701.277749:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787823701.277778:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793510e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+16:14997:x1874668651901312:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787823701.278131:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793510e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+16:14997:x1874668651901312:12345-0@lo:501:mount.lustre.0 Request processed in 374us (6469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823701.278139:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787823701.278942:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea8d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14997:1874668651901312:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787823701.278999:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea8d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14997:1874668651901440:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787823701.279368:0:14997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823701.279437:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908c15c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787823701.290301:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651901440 00000100:00100000:2.0:1787823701.290317:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651901440 00000100:00100000:2.0:1787823701.290372:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787823701.290383:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793510d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+16:14997:x1874668651901440:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787823701.290642:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793510d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+16:14997:x1874668651901440:12345-0@lo:503:mount.lustre.0 Request processed in 260us (11274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823701.290650:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787823701.291236:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea8d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14997:1874668651901440:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787823701.297668:0:14997:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787823701.297797:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea8d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14997:1874668651901568:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787823701.297918:0:14997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823701.297971:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908c15c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787823701.300359:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651901568 00000100:00100000:2.0:1787823701.300378:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651901568 00000100:00100000:2.0:1787823701.300449:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787823701.300461:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793510fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+16:14997:x1874668651901568:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787823701.304453:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea8d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14997:1874668651901568:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787823701.304856:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787823701.304925:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787823701.304960:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000100:00100000:2.0:1787823701.305772:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793510fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+16:14997:x1874668651901568:12345-0@lo:502:mount.lustre.0 Request processed in 2548us (5088us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823701.305788:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000040:00080000:0.0:1787823701.308242:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787823701.308712:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787823701.308812:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787823701.308854:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787823701.308917:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787823701.308964:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787823701.308996:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787823701.311260:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787823701.311960:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787823701.312005:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787823701.312370:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787823701.312423:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787823701.312459:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787823701.312493:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787823701.312542:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787823701.314977:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787823701.315442:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787823701.315521:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787823701.316376:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787823701.316430:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787823701.316504:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787823701.316539:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1787823701.318236:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1787823701.320248:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1787823701.321467:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1787823701.321513:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1787823701.322787:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1787823701.322854:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1787823701.322903:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1787823701.322939:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1787823701.322993:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1787823701.323045:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1787823701.323094:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1787823701.323151:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1787823701.323192:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1787823701.323243:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1787823701.323309:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1787823701.323365:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7802e121c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14997:1874668651901696:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787823701.323449:0:14997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823701.323503:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79037cd480 going to sleep for 11 seconds 00000100:00100000:0.0:1787823701.326820:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651901696 00000100:00100000:0.0:1787823701.326833:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651901696 00000100:00100000:0.0:1787823701.326901:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787823701.326912:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793510e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+16:14997:x1874668651901696:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787823701.327224:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793510e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+16:14997:x1874668651901696:12345-0@lo:502:mount.lustre.0 Request processed in 314us (3775us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823701.327232:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787823701.327297:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7802e121c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14997:1874668651901696:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787823701.327428:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1787823701.327444:0:14997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1787823701.331477:0:15020:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787823701.331494:0:15020:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8e7936e68000) 00000020:00000080:0.0:1787823701.331517:0:15020:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1787823701.331910:0:15020:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e79187b1000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787823701.331915:0:15020:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e79187b1000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787823701.331918:0:15020:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e79187b1000 3 00010000:00080000:0.0:1787823701.331955:0:15020:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e7920752000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.135@tcp at head 00010000:00010000:2.0:1787823701.334654:0:15020:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1787823701.334914:0:15020:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787823701.334955:0:15020:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787823701.334970:0:15020:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5d1142b832482875 00000100:00080000:2.0:1787823701.334982:0:15020:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787823701.334988:0:15020:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e7920752000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:2.0:1787823701.335035:0:15020:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e793a280780 x1874668651901824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787823701.335070:0:15020:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787823701.335223:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a280780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1874668651901824:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787823701.335311:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823701.335380:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651901824 00000100:00100000:1.0:1787823701.335388:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651901824 00000100:00100000:1.0:1787823701.335418:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787823701.335425:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3304:x1874668651901824:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787823701.335446:0:14317:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 442 last 0 00000020:00000080:1.0:1787823701.335478:0:14317:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5d1142b83248287c 00000004:00100000:1.0:1787823701.335491:0:14317:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787823701.335520:0:14317:0:(import.c:65:import_set_state_nolock()) ffff8e7907d37000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787823701.335570:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874668651901824:12345-0@lo:38:llog_process_th.0 Request processed in 144us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823701.335577:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787823701.335612:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e793a280780 x1874668651901824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787823711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787823701.335623:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787823701.335631:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1787823701.335637:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787823701.335641:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787823701.335643:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8e7920752000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787823701.335649:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a280780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1874668651901824:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1787823701.336380:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787823701.336387:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787823701.336395:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787823701.336398:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787823701.336448:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874668651901952:0@lo:400:kworker.0 00000100:00100000:1.0:1787823701.336484:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823701.336533:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651901952 00000100:00100000:1.0:1787823701.336538:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651901952 00000100:00100000:1.0:1787823701.336581:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787823701.336589:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874668651901952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823701.336632:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874668651901952:12345-0@lo:400:kworker.0 Request processed in 44us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823701.336639:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787823701.336668:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e7922a0e940 x1874668651901952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787823717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787823701.336679:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874668651901952:0@lo:400:kworker.0 00000040:00080000:3.0:1787823701.340471:0:15020:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1787823701.348473:0:14997:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787823701.348520:0:14997:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787823701.348579:0:14997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e79358d2200/0x5d1142b832482860 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832482867 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823701.348592:0:14997:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e79358d2200/0x5d1142b832482860 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832482867 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787823701.348853:0:14997:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787823701.348856:0:14997:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787823701.348857:0:14997:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787823701.348858:0:14997:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787823701.348859:0:14997:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787823701.348864:0:14997:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787823701.348874:0:14997:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787823701.348876:0:14997:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787823701.348877:0:14997:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787823701.348881:0:14997:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1787823701.348883:0:14997:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787823701.348884:0:14997:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787823701.348885:0:14997:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787823701.348886:0:14997:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787823701.348887:0:14997:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787823701.348888:0:14997:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787823701.348889:0:14997:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787823701.348889:0:14997:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787823701.348890:0:14997:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787823701.348917:0:14997:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787823701.348943:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14997:1874668651902080:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787823701.349038:0:14997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823701.349083:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79037f6300 going to sleep for 11 seconds 00000100:00100000:3.0:1787823701.349240:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651902080 00000100:00100000:3.0:1787823701.349248:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651902080 00000100:00100000:3.0:1787823701.349315:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787823701.349325:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793510f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+16:14997:x1874668651902080:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787823701.349354:0:14309:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787823701.349369:0:14309:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787823701.392859:0:14309:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787823701.392908:0:14309:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787823701.393412:0:14332:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787823701.393418:0:14332:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787823701.393443:0:14332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e7920eebe00/0x5d1142b832482883 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823701.393464:0:14332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e793a40e800/0x5d1142b8324827f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b8324827e9 expref: 16 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823701.393472:0:14332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e7920eebe00/0x5d1142b832482883 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823701.393518:0:14332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e793a40e800/0x5d1142b8324827f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d1142b8324827e9 expref: 16 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823701.393532:0:14332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e793a40e800/0x5d1142b8324827f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d1142b8324827e9 expref: 16 pid: 14311 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823701.393630:0:14332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14332:1874668651902208:0@lo:104: 00000100:00100000:1.0:1787823701.393703:0:14332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823701.393795:0:14332:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79037f6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787823701.393996:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651902208 00000100:00100000:0.0:1787823701.394003:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651902208 00000100:00100000:0.0:1787823701.394060:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787823701.394070:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+3:14332:x1874668651902208:12345-0@lo:104: 00010000:00010000:0.0:1787823701.394082:0:14300:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff8e793a40ea00/0x5d1142b8324827e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b8324827f0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823701.394371:0:14300:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787823701.394378:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+3:14332:x1874668651902208:12345-0@lo:104: Request processed in 310us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823701.394384:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787823701.394408:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787823701.394414:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e793a40ea00/0x5d1142b8324827e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b8324827f0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823701.394423:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40ea00 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:0.0:1787823701.394427:0:14304:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e793a40ea00/0x5d1142b8324827e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d1142b8324827f0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823701.394436:0:14304:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e793a40ea00/0x5d1142b8324827e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d1142b8324827f0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787823701.394455:0:14304:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e793a40ea00/0x5d1142b8324827e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d1142b8324827f0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787823701.394461:0:14304:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787823701.394490:0:14304:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e793a40ea00/0x5d1142b8324827e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b8324827f0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823701.394497:0:14304:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787823701.394515:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e793a40ea00/0x5d1142b8324827e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b8324827f0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823701.394522:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e793a40ea00/0x5d1142b8324827e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b8324827f0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823701.394538:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823701.394540:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823701.394542:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787823701.394614:0:14332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14332:1874668651902208:0@lo:104: 00010000:00010000:2.0:1787823701.394634:0:14332:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e7920eebe00/0x5d1142b832482883 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823701.394855:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7802e121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b00b7bac-c389-4a58-8ac8-b4f04764fb77:3306:1874668651902336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787823701.394899:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823701.395514:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651902336 00000100:00100000:0.0:1787823701.395521:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651902336 00010000:00010000:0.0:1787823701.395546:0:14303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e793a40e800/0x5d1142b8324827f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b8324827e9 expref: 17 pid: 14311 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823701.395636:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787823701.395644:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+17:3306:x1874668651902336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787823701.395656:0:14303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787823701.395661:0:14303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e793a40e800/0x5d1142b8324827f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b8324827e9 expref: 17 pid: 14311 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823701.395673:0:14303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e793a40e800/0x5d1142b8324827f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d1142b8324827e9 expref: 17 pid: 14311 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823701.395696:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e793a40e800/0x5d1142b8324827f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d1142b8324827e9 expref: 17 pid: 14311 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823701.395710:0:14303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e7920eebe00/0x5d1142b832482883 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823701.395718:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7920eebe00/0x5d1142b832482883 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787823701.395731:0:14303:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005826509s 00010000:00010000:0.0:1787823701.395735:0:14303:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7920eebe00/0x5d1142b832482883 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823701.395753:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7920eebe00/0x5d1142b832482883 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823701.395781:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e7920eebe00/0x5d1142b832482883 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823701.395788:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e7920eebe00/0x5d1142b832482883 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823701.395794:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eebe00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:0.0:1787823701.395798:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e7920eebe00/0x5d1142b832482883 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823701.395805:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e7920eebe00/0x5d1142b832482883 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823701.395820:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e7920eebe00/0x5d1142b832482883 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823701.395836:0:14303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787823701.395889:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+16:3306:x1874668651902336:12345-0@lo:103:ldlm_bl.0 Request processed in 246us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823701.395896:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787823701.395919:0:14332:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e7920eebe00/0x5d1142b832482883 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823701.395926:0:14332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e7920eebe00/0x5d1142b832482883 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823701.395933:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7920eebe00/0x5d1142b832482883 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823701.396446:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7802e121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b00b7bac-c389-4a58-8ac8-b4f04764fb77:3306:1874668651902336:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787823701.412784:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793510f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+15:14997:x1874668651902080:12345-0@lo:253:mount.lustre.0 Request processed in 63413us (63700us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823701.412801:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787823701.413234:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14997:1874668651902080:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787823701.413249:0:14997:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787823701.413253:0:14997:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787823701.413255:0:14997:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787823701.413256:0:14997:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787823701.413257:0:14997:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787823701.413259:0:14997:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787823701.413260:0:14997:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787823701.413261:0:14997:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787823701.413264:0:14997:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787823701.413265:0:14997:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787823701.413340:0:14997:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787823701.426458:0:14997:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787823701.426715:0:14997:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787823701.426937:0:14997:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787823701.427080:0:14997:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787823701.427890:0:14997:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787823701.428940:0:14997:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787823701.436484:0:14997:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787823701.560212:0:14997:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787823701.560222:0:14997:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787823701.560256:0:14997:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787823701.560311:0:14997:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.135@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787823701.560327:0:14997:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787823701.560354:0:14997:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1787823701.865938:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823702.890809:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787823703.017847:0:14313:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787823703.017864:0:14313:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e79358bc000 from 7 10000000:01000000:0.0:1787823703.017870:0:14313:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787823703.017915:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a40ec00/0x5d1142b83248288a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823703.017927:0:14313:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e793a40ec00/0x5d1142b83248288a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823703.017938:0:14313:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e793a40ec00/0x5d1142b83248288a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823703.017974:0:14313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7802e13c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14313:1874668651902464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787823703.018042:0:14313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823703.018283:0:14313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79037cd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787823703.018803:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651902464 00000100:00100000:3.0:1787823703.018811:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651902464 00000100:00100000:3.0:1787823703.018866:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787823703.018876:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79100ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+15:14313:x1874668651902464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787823703.018895:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823703.018909:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e793a26d000/0x5d1142b832482891 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b83248288a expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823703.018930:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e793a26d000/0x5d1142b832482891 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b83248288a expref: 16 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823703.018940:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e793a26d000/0x5d1142b832482891 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b83248288a expref: 16 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823703.018950:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a26d000, rc 0) 00000100:00100000:3.0:1787823703.019004:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79100ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+16:14313:x1874668651902464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823703.019012:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787823703.019157:0:14313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7802e13c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14313:1874668651902464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787823703.019171:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e793a40ec00/0x5d1142b83248288a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832482891 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823703.019180:0:14313:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e793a40ec00/0x5d1142b83248288a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b832482891 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823703.019233:0:14313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7802e13c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14313:1874668651902592:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787823703.019267:0:14313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823703.019285:0:14313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79037cd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787823703.019338:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651902592 00000100:00100000:1.0:1787823703.019343:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651902592 00000100:00100000:1.0:1787823703.019375:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787823703.019384:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79100ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+16:14313:x1874668651902592:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787823703.019397:0:14310:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787823703.019417:0:14310:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787823703.019420:0:14310:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1787823703.019500:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79100ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+16:14313:x1874668651902592:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 117us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823703.019509:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787823703.019541:0:14313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7802e13c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14313:1874668651902592:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787823703.019599:0:14313:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787823703.019606:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a40ec00/0x5d1142b83248288a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832482891 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823703.019615:0:14313:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e793a40ec00/0x5d1142b83248288a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832482891 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823703.918939:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823704.939037:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823705.964415:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787823706.602735:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787823706.602742:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787823706.602745:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787823706.602748:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787823706.602832:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a282940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874668651902976:0@lo:400:kworker.0 00000100:00100000:2.0:1787823706.602910:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823706.603004:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651902976 00000100:00100000:2.0:1787823706.603013:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651902976 00000100:00100000:2.0:1787823706.603072:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787823706.603082:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874668651902976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823706.603135:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874668651902976:12345-0@lo:400:kworker.0 Request processed in 55us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823706.603154:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787823706.603200:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e793a282940 x1874668651902976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787823722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823706.603214:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a282940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874668651902976:0@lo:400:kworker.0 00000100:00100000:0.0:1787823706.603412:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b00b7bac-c389-4a58-8ac8-b4f04764fb77:3307:1874668651902720:0@lo:400:kworker.0 00000100:00100000:0.0:1787823706.603449:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823706.603485:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787823706.603491:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a2812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874668651902848:0@lo:400:kworker.0 00000100:00100000:0.0:1787823706.603517:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823706.603543:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651902848 00000100:00100000:0.0:1787823706.603547:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651902848 00000100:00100000:0.0:1787823706.603572:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787823706.603578:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7802e11e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874668651902848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787823706.603612:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7802e11e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874668651902848:12345-0@lo:400:kworker.0 Request processed in 34us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823706.603618:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787823706.603640:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e793a2812c0 x1874668651902848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787823722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787823706.603669:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a2812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874668651902848:0@lo:400:kworker.0 00000100:00080000:3.0:1787823706.603842:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787823706.604484:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651902720 00000100:00100000:2.0:1787823706.604490:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651902720 00000100:00100000:2.0:1787823706.604533:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787823706.604542:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79100ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+16:3307:x1874668651902720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823706.604605:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79100ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+16:3307:x1874668651902720:12345-0@lo:400:kworker.0 Request processed in 64us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823706.604611:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787823706.604804:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b00b7bac-c389-4a58-8ac8-b4f04764fb77:3307:1874668651902720:0@lo:400:kworker.0 00010000:00010000:2.0:1787823706.986010:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823708.010118:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787823708.932588:0:15363:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg235-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787823709.034963:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787823709.419240:0:14348:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787823710.058218:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823711.083563:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787823711.722148:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787823711.722155:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787823711.722158:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787823711.722162:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787823711.722216:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874668651903232:0@lo:400:kworker.0 00000100:00100000:3.0:1787823711.722294:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823711.722388:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787823711.722394:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874668651903360:0@lo:400:kworker.0 00000100:00100000:3.0:1787823711.722460:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823711.722753:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651903232 00000100:00100000:3.0:1787823711.722809:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651903232 00000100:00100000:3.0:1787823711.722868:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651903360 00000100:00100000:3.0:1787823711.722872:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651903360 00000100:00100000:3.0:1787823711.722905:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787823711.723018:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea8e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b00b7bac-c389-4a58-8ac8-b4f04764fb77:3306:1874668651903104:0@lo:400:kworker.0 00000100:00100000:1.0:1787823711.723060:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823711.723100:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651903104 00000100:00100000:1.0:1787823711.723104:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651903104 00000100:00100000:1.0:1787823711.723130:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787823711.723137:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79100ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+16:3306:x1874668651903104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823711.723191:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79100ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+16:3306:x1874668651903104:12345-0@lo:400:kworker.0 Request processed in 54us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823711.723199:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787823711.723251:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea8e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b00b7bac-c389-4a58-8ac8-b4f04764fb77:3306:1874668651903104:0@lo:400:kworker.0 00000100:00100000:1.0:1787823711.723315:0:14318:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787823711.723323:0:14318:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1787823711.723468:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787823711.723486:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874668651903360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823711.723801:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874668651903360:12345-0@lo:400:kworker.0 Request processed in 315us (1339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823711.723808:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787823711.724082:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874668651903232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823711.724127:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874668651903232:12345-0@lo:400:kworker.0 Request processed in 1211us (1832us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823711.724134:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787823711.724153:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787823711.724179:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e792ea8e940 x1874668651903360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787823727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823711.724191:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874668651903360:0@lo:400:kworker.0 00010000:00080000:3.0:1787823711.724204:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e792ea8c3c0 x1874668651903232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787823727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787823711.724213:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874668651903232:0@lo:400:kworker.0 00010000:00010000:1.0:1787823712.106077:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823712.619008:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787823697/real 1787823697] req@ffff8e7802e10b40 x1874668651899136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787823712 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787823712.619038:0:3304:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e7802e10b40 x1874668651899136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787823712 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787823712.619049:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787823697/real 1787823697] req@ffff8e7802e12d00 x1874668651899264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787823712 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787823712.619060:0:3304:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e7802e12d00 x1874668651899264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787823712 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787823712.619079:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8e79358ef000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787823712.619106:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787823712.619111:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7802e10b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874668651899136:0@lo:8:kworker.0 00000100:00080000:1.0:1787823712.619117:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8e7918291800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787823712.619122:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787823712.619124:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7802e12d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874668651899264:0@lo:8:kworker.0 00000100:00080000:2.0:1787823712.619249:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787823712.619254:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787823712.619256:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e79358ef000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787823712.619261:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 438 00000100:00080000:2.0:1787823712.619266:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787823712.619273:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e79358ef000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:2.0:1787823712.619292:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e793a281680 x1874668651903616/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787823712.619306:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787823712.619309:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787823712.619320:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e7918291800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787823712.619324:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 438 00000100:00080000:2.0:1787823712.619326:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787823712.619330:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e7918291800 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:2.0:1787823712.619340:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e793a282d00 x1874668651903744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787823712.619391:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a283c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874668651903872:0@lo:400:kworker.0 00000100:00100000:2.0:1787823712.619462:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823712.619511:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787823712.619518:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a282940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b00b7bac-c389-4a58-8ac8-b4f04764fb77:3306:1874668651903488:0@lo:400:kworker.0 00000100:00100000:2.0:1787823712.619547:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823712.619574:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787823712.619582:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a281a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874668651904000:0@lo:400:kworker.0 00000100:00100000:2.0:1787823712.619604:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823712.619646:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651903872 00000100:00100000:2.0:1787823712.619652:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651903872 00000100:00100000:2.0:1787823712.619694:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651904000 00000100:00100000:2.0:1787823712.619697:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651904000 00000100:00100000:2.0:1787823712.619720:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787823712.619729:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a280f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874668651903872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823712.619816:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a280f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874668651903872:12345-0@lo:400:kworker.0 Request processed in 88us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823712.619823:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787823712.619842:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787823712.619849:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a282580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874668651904000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823712.619877:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a282580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874668651904000:12345-0@lo:400:kworker.0 Request processed in 29us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823712.619890:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787823712.619911:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651903488 00000100:00100000:2.0:1787823712.619915:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651903488 00000100:00100000:2.0:1787823712.619940:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787823712.619946:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79100ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+16:3306:x1874668651903488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823712.619975:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79100ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+16:3306:x1874668651903488:12345-0@lo:400:kworker.0 Request processed in 29us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823712.619981:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1787823712.620027:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e793a281a40 x1874668651904000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787823728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823712.620039:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a281a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874668651904000:0@lo:400:kworker.0 00000100:00100000:2.0:1787823712.620054:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a281680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874668651903616:0@lo:8:kworker.0 00000100:00100000:2.0:1787823712.620081:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823712.620099:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a282d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874668651903744:0@lo:8:kworker.0 00000100:00100000:2.0:1787823712.620119:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823712.620149:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651903616 00000100:00100000:2.0:1787823712.620153:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651903616 00000100:00100000:2.0:1787823712.620166:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651903744 00000100:00100000:2.0:1787823712.620168:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651903744 00000100:00100000:2.0:1787823712.620177:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787823712.620181:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a281a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3304:x1874668651903616:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787823712.620203:0:15001:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 453 last 0 00000020:00000080:2.0:1787823712.620231:0:15001:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d1142b832482898 00002000:00100000:2.0:1787823712.620243:0:15001:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8e793a7fc800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787823712.620246:0:15001:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1787823712.620255:0:15001:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787823712.620595:0:15001:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787823712.620616:0:15001:0:(import.c:65:import_set_state_nolock()) ffff8e793a7ff000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787823712.620655:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a281a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1874668651903616:12345-0@lo:8:kworker.0 Request processed in 472us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823712.620662:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787823712.620674:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787823712.620678:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a280b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3304:x1874668651903744:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787823712.620688:0:15001:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787823712.620712:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a280b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3304:x1874668651903744:12345-0@lo:8:kworker.0 Request processed in 32us (592us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787823712.620718:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787823712.620743:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a282940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b00b7bac-c389-4a58-8ac8-b4f04764fb77:3306:1874668651903488:0@lo:400:kworker.0 00010000:00080000:2.0:1787823712.620789:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e793a283c00 x1874668651903872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787823728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823712.620800:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a283c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874668651903872:0@lo:400:kworker.0 00010000:00080000:2.0:1787823712.620828:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e793a281680 x1874668651903616/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787823732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823712.620836:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787823712.620842:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787823712.620851:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787823712.620856:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787823712.620859:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8e79358ef000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787823712.620872:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787823712.620877:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a281680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874668651903616:0@lo:8:kworker.0 00000100:00080000:2.0:1787823712.620897:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8e7918291800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787823712.620901:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787823712.620904:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a282d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874668651903744:0@lo:8:kworker.0 00000004:00080000:2.0:1787823712.620947:0:14339:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:2.0:1787823712.620963:0:14339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a281680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14339:1874668651904256:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787823712.620988:0:14339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823712.621004:0:14339:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7904944600 going to sleep for 11 seconds 00000004:00080000:2.0:1787823712.621021:0:14338:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787823712.621237:0:14338:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 453475477606ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787823712.621260:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a282d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651904128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787823712.621288:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823712.621313:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651904256 00000100:00100000:2.0:1787823712.621318:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651904256 00000100:00100000:2.0:1787823712.621352:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787823712.621358:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a283c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14339:x1874668651904256:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787823712.622901:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651904128 00000100:00100000:1.0:1787823712.622910:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651904128 00000100:00100000:1.0:1787823712.622950:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787823712.622960:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a282940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1874668651904128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787823712.622998:0:15003:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787823712.623079:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a282940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1874668651904128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (1790us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823712.623087:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787823712.623345:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e793a282d00 x1874668651904128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823728 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787823712.623366:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a282d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651904128:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787823712.630749:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1787823712.635693:0:15001:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1787823712.635706:0:15001:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1787823712.635713:0:15001:0:(ofd_dev.c:1494:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:2.0:1787823712.658165:0:15001:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787823712.658178:0:15001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005afb6609/0x5d1142b83248289f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.658195:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=453s v=(0 0) 00010000:00010000:2.0:1787823712.658200:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823712.658207:0:15001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005afb6609/0x5d1142b83248289f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.658237:0:15001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005afb6609/0x5d1142b83248289f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.658249:0:15001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005afb6609/0x5d1142b83248289f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.658257:0:15001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005afb6609/0x5d1142b83248289f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.658279:0:15001:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787823712.658292:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787823712.658298:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005afb6609/0x5d1142b83248289f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.658306:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3600 already unused, calling callback (ffffffffc1649440) 00010000:00010000:2.0:1787823712.658311:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005afb6609/0x5d1142b83248289f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.658320:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005afb6609/0x5d1142b83248289f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.658337:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005afb6609/0x5d1142b83248289f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.658345:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005afb6609/0x5d1142b83248289f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.658373:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823712.658374:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823712.658376:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787823712.659043:0:15001:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787823712.659050:0:15001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a2b66f8/0x5d1142b8324828a6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.659061:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=453s v=(0 0) 00010000:00010000:2.0:1787823712.659065:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823712.659071:0:15001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a2b66f8/0x5d1142b8324828a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.659080:0:15001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a2b66f8/0x5d1142b8324828a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.659088:0:15001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a2b66f8/0x5d1142b8324828a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.659095:0:15001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a2b66f8/0x5d1142b8324828a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.659113:0:15001:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787823712.659123:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787823712.659128:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a2b66f8/0x5d1142b8324828a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.659146:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3400 already unused, calling callback (ffffffffc1649440) 00010000:00010000:2.0:1787823712.659150:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a2b66f8/0x5d1142b8324828a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.659158:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a2b66f8/0x5d1142b8324828a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.659170:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a2b66f8/0x5d1142b8324828a6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.659177:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a2b66f8/0x5d1142b8324828a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.659192:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823712.659194:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823712.659195:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787823712.659581:0:15001:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787823712.659587:0:15001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d6de362/0x5d1142b8324828ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.659596:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=453s v=(0 0) 00010000:00010000:2.0:1787823712.659600:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823712.659604:0:15001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d6de362/0x5d1142b8324828ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.659613:0:15001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d6de362/0x5d1142b8324828ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.659627:0:15001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d6de362/0x5d1142b8324828ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.659634:0:15001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d6de362/0x5d1142b8324828ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.659648:0:15001:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787823712.659656:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787823712.659660:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d6de362/0x5d1142b8324828ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.659666:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3c00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:2.0:1787823712.659670:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d6de362/0x5d1142b8324828ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.659677:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d6de362/0x5d1142b8324828ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.659687:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d6de362/0x5d1142b8324828ad lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.659694:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d6de362/0x5d1142b8324828ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.659707:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823712.659713:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823712.659715:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787823712.660139:0:15001:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787823712.660146:0:15001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c53dacce/0x5d1142b8324828b4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.660154:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=453s v=(0 0) 00010000:00010000:2.0:1787823712.660158:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823712.660163:0:15001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c53dacce/0x5d1142b8324828b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.660171:0:15001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c53dacce/0x5d1142b8324828b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.660180:0:15001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c53dacce/0x5d1142b8324828b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.660187:0:15001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c53dacce/0x5d1142b8324828b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.660201:0:15001:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787823712.660210:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787823712.660214:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c53dacce/0x5d1142b8324828b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.660220:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3e00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:2.0:1787823712.660223:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c53dacce/0x5d1142b8324828b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.660241:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c53dacce/0x5d1142b8324828b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.660251:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c53dacce/0x5d1142b8324828b4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.660257:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c53dacce/0x5d1142b8324828b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.660270:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823712.660272:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823712.660274:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787823712.660654:0:15001:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787823712.660660:0:15001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aee9706f/0x5d1142b8324828bb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.660668:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=453s v=(0 0) 00010000:00010000:2.0:1787823712.660671:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823712.660676:0:15001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aee9706f/0x5d1142b8324828bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.660686:0:15001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aee9706f/0x5d1142b8324828bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.660694:0:15001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aee9706f/0x5d1142b8324828bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.660708:0:15001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aee9706f/0x5d1142b8324828bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.660722:0:15001:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787823712.660730:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787823712.660734:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aee9706f/0x5d1142b8324828bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.660740:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d2400 already unused, calling callback (ffffffffc1649440) 00010000:00010000:2.0:1787823712.660743:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aee9706f/0x5d1142b8324828bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.660750:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aee9706f/0x5d1142b8324828bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787823712.664352:0:15001:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787823712.664366:0:15001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d741ea82/0x5d1142b8324828c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.664385:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1787823712.664390:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787823712.664397:0:15001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d741ea82/0x5d1142b8324828c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.664413:0:15001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d741ea82/0x5d1142b8324828c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.664423:0:15001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d741ea82/0x5d1142b8324828c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.664430:0:15001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d741ea82/0x5d1142b8324828c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.664451:0:15001:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787823712.664464:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:0.0:1787823712.664987:0:15001:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787823712.664994:0:15001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000402786d7/0x5d1142b8324828c9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.665013:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1787823712.665016:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787823712.665021:0:15001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000402786d7/0x5d1142b8324828c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.665029:0:15001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000402786d7/0x5d1142b8324828c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.665037:0:15001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000402786d7/0x5d1142b8324828c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.665043:0:15001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000402786d7/0x5d1142b8324828c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.665051:0:15001:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787823712.665374:0:15001:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787823712.665380:0:15001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000455794f8/0x5d1142b8324828d0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.665388:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1787823712.665391:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787823712.665395:0:15001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000455794f8/0x5d1142b8324828d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.665405:0:15001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000455794f8/0x5d1142b8324828d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.665423:0:15001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000455794f8/0x5d1142b8324828d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.665429:0:15001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000455794f8/0x5d1142b8324828d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.665436:0:15001:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787823712.669154:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aee9706f/0x5d1142b8324828bb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.669176:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aee9706f/0x5d1142b8324828bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.669202:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787823712.669207:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000402786d7/0x5d1142b8324828c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.669235:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40f800 already unused, calling callback (ffffffffc1649440) 00010000:00010000:2.0:1787823712.669239:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000402786d7/0x5d1142b8324828c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.669250:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000402786d7/0x5d1142b8324828c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.669262:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000402786d7/0x5d1142b8324828c9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.669269:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000402786d7/0x5d1142b8324828c9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.669282:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787823712.669285:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000455794f8/0x5d1142b8324828d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.669292:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40f600 already unused, calling callback (ffffffffc1649440) 00010000:00010000:2.0:1787823712.669296:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000455794f8/0x5d1142b8324828d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.669304:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000455794f8/0x5d1142b8324828d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.669313:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000455794f8/0x5d1142b8324828d0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.669326:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000455794f8/0x5d1142b8324828d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.669338:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823712.669340:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823712.669342:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787823712.669856:0:15001:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787823712.669864:0:15001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060f6203e/0x5d1142b8324828d7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.669877:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1787823712.669881:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787823712.669888:0:15001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060f6203e/0x5d1142b8324828d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.669900:0:15001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060f6203e/0x5d1142b8324828d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.673980:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823712.673990:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823712.673993:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823712.674482:0:15001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060f6203e/0x5d1142b8324828d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.674492:0:15001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060f6203e/0x5d1142b8324828d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.674616:0:15001:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787823712.674630:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787823712.674636:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060f6203e/0x5d1142b8324828d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.674645:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40e400 already unused, calling callback (ffffffffc1649440) 00010000:00010000:0.0:1787823712.674649:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060f6203e/0x5d1142b8324828d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.674659:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060f6203e/0x5d1142b8324828d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.674681:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060f6203e/0x5d1142b8324828d7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.674689:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060f6203e/0x5d1142b8324828d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.674709:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823712.674711:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823712.674712:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787823712.675902:0:15001:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787823712.676098:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d741ea82/0x5d1142b8324828c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.676110:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40fe00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:1.0:1787823712.676114:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d741ea82/0x5d1142b8324828c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.676123:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d741ea82/0x5d1142b8324828c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.676144:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d741ea82/0x5d1142b8324828c2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.676151:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d741ea82/0x5d1142b8324828c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.676170:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823712.676172:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823712.676174:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823712.676368:0:15001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db4cb9ec/0x5d1142b8324828de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.676382:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1787823712.676396:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787823712.676404:0:15001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db4cb9ec/0x5d1142b8324828de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.676418:0:15001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db4cb9ec/0x5d1142b8324828de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.676428:0:15001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db4cb9ec/0x5d1142b8324828de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.676436:0:15001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db4cb9ec/0x5d1142b8324828de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.677000:0:15001:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787823712.677570:0:15001:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787823712.677578:0:15001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d1569e9/0x5d1142b8324828e5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.677591:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1787823712.677595:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787823712.677600:0:15001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d1569e9/0x5d1142b8324828e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.677612:0:15001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d1569e9/0x5d1142b8324828e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.677621:0:15001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d1569e9/0x5d1142b8324828e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.677635:0:15001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d1569e9/0x5d1142b8324828e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.681127:0:15517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787823712.681144:0:15517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db4cb9ec/0x5d1142b8324828de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.681159:0:15517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40fc00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:2.0:1787823712.681164:0:15517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db4cb9ec/0x5d1142b8324828de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.681175:0:15517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db4cb9ec/0x5d1142b8324828de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.681197:0:15517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db4cb9ec/0x5d1142b8324828de lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.681205:0:15517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db4cb9ec/0x5d1142b8324828de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.681239:0:15517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787823712.681242:0:15517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d1569e9/0x5d1142b8324828e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.681249:0:15517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40f000 already unused, calling callback (ffffffffc1649440) 00010000:00010000:2.0:1787823712.681251:0:15517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d1569e9/0x5d1142b8324828e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.681259:0:15517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d1569e9/0x5d1142b8324828e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.681269:0:15517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d1569e9/0x5d1142b8324828e5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.681276:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823712.681278:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823712.681280:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823712.683736:0:15001:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787823712.683748:0:15001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d1569e9/0x5d1142b8324828e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787823712.684511:0:15001:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787823712.684519:0:15001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093b939da/0x5d1142b8324828ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.684533:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1787823712.684538:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787823712.684545:0:15001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093b939da/0x5d1142b8324828ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.684559:0:15001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093b939da/0x5d1142b8324828ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.684569:0:15001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093b939da/0x5d1142b8324828ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.684576:0:15001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093b939da/0x5d1142b8324828ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.684610:0:15001:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787823712.684623:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787823712.684629:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093b939da/0x5d1142b8324828ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.684636:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40e200 already unused, calling callback (ffffffffc1649440) 00010000:00010000:0.0:1787823712.684640:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093b939da/0x5d1142b8324828ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.684650:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093b939da/0x5d1142b8324828ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.684666:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093b939da/0x5d1142b8324828ec lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.684673:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093b939da/0x5d1142b8324828ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.684688:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823712.684690:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823712.684692:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823712.687029:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787823712.688316:0:15001:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787823712.688330:0:15001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000912e0012/0x5d1142b8324828f3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.688348:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1787823712.688363:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787823712.688371:0:15001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000912e0012/0x5d1142b8324828f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.688386:0:15001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000912e0012/0x5d1142b8324828f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.688397:0:15001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000912e0012/0x5d1142b8324828f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.688405:0:15001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000912e0012/0x5d1142b8324828f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.688470:0:15001:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787823712.690201:0:15001:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787823712.690213:0:15001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8987c62/0x5d1142b8324828fa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.690228:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1787823712.690233:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787823712.690239:0:15001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8987c62/0x5d1142b8324828fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.690251:0:15001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8987c62/0x5d1142b8324828fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.690261:0:15001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8987c62/0x5d1142b8324828fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.690275:0:15001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8987c62/0x5d1142b8324828fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.692920:0:15517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787823712.692945:0:15517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000912e0012/0x5d1142b8324828f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.692958:0:15517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40ea00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:1.0:1787823712.692963:0:15517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000912e0012/0x5d1142b8324828f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.692973:0:15517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000912e0012/0x5d1142b8324828f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.692993:0:15517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000912e0012/0x5d1142b8324828f3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.693001:0:15517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000912e0012/0x5d1142b8324828f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.693411:0:15517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787823712.693417:0:15517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8987c62/0x5d1142b8324828fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.693425:0:15517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40e800 already unused, calling callback (ffffffffc1649440) 00010000:00010000:1.0:1787823712.693428:0:15517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8987c62/0x5d1142b8324828fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.693436:0:15517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8987c62/0x5d1142b8324828fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.693457:0:15517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8987c62/0x5d1142b8324828fa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.693465:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823712.693467:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823712.693469:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823712.696400:0:15001:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787823712.696419:0:15001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8987c62/0x5d1142b8324828fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.697005:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787823712.704678:0:15001:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787823712.704694:0:15001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8987c62/0x5d1142b832482901 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.704713:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1787823712.704718:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787823712.704725:0:15001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8987c62/0x5d1142b832482901 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.704738:0:15001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8987c62/0x5d1142b832482901 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.704748:0:15001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8987c62/0x5d1142b832482901 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.704755:0:15001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8987c62/0x5d1142b832482901 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.706108:0:15001:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787823712.706670:0:15001:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787823712.706677:0:15001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093b939da/0x5d1142b832482908 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.706689:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1787823712.706693:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787823712.706699:0:15001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093b939da/0x5d1142b832482908 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.706712:0:15001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093b939da/0x5d1142b832482908 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.706721:0:15001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093b939da/0x5d1142b832482908 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.706729:0:15001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093b939da/0x5d1142b832482908 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.706746:0:15001:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787823712.707257:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787823712.707266:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8987c62/0x5d1142b832482901 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.707275:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40e800 already unused, calling callback (ffffffffc1649440) 00010000:00010000:1.0:1787823712.707281:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8987c62/0x5d1142b832482901 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.707289:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8987c62/0x5d1142b832482901 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.707309:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8987c62/0x5d1142b832482901 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.707316:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8987c62/0x5d1142b832482901 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.707334:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787823712.707337:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093b939da/0x5d1142b832482908 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.707351:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40e200 already unused, calling callback (ffffffffc1649440) 00010000:00010000:1.0:1787823712.707355:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093b939da/0x5d1142b832482908 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.707362:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093b939da/0x5d1142b832482908 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.707373:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093b939da/0x5d1142b832482908 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.707381:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093b939da/0x5d1142b832482908 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.707393:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823712.707395:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823712.707397:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787823712.708553:0:15001:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787823712.708563:0:15001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d1569e9/0x5d1142b83248290f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.708576:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1787823712.708586:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787823712.708592:0:15001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d1569e9/0x5d1142b83248290f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.708603:0:15001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d1569e9/0x5d1142b83248290f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.708613:0:15001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d1569e9/0x5d1142b83248290f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.708620:0:15001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d1569e9/0x5d1142b83248290f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.708646:0:15001:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787823712.709068:0:15001:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787823712.709074:0:15001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060f6203e/0x5d1142b832482916 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.709083:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1787823712.709086:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787823712.709090:0:15001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060f6203e/0x5d1142b832482916 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.709100:0:15001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060f6203e/0x5d1142b832482916 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.709107:0:15001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060f6203e/0x5d1142b832482916 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.709120:0:15001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060f6203e/0x5d1142b832482916 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.709130:0:15001:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787823712.709464:0:15001:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787823712.709470:0:15001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db4cb9ec/0x5d1142b83248291d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.709478:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1787823712.709481:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787823712.709485:0:15001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db4cb9ec/0x5d1142b83248291d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.709494:0:15001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db4cb9ec/0x5d1142b83248291d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.709502:0:15001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db4cb9ec/0x5d1142b83248291d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.709510:0:15001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db4cb9ec/0x5d1142b83248291d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.709517:0:15001:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1787823712.712199:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787823712.712213:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d1569e9/0x5d1142b83248290f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.712226:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40f000 already unused, calling callback (ffffffffc1649440) 00010000:00010000:1.0:1787823712.712230:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d1569e9/0x5d1142b83248290f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.712240:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d1569e9/0x5d1142b83248290f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.712269:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d1569e9/0x5d1142b83248290f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.712276:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d1569e9/0x5d1142b83248290f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.712296:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787823712.712300:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060f6203e/0x5d1142b832482916 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.712306:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40e400 already unused, calling callback (ffffffffc1649440) 00010000:00010000:1.0:1787823712.712309:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060f6203e/0x5d1142b832482916 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.712316:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060f6203e/0x5d1142b832482916 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.712325:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060f6203e/0x5d1142b832482916 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.712331:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060f6203e/0x5d1142b832482916 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.712342:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787823712.712346:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db4cb9ec/0x5d1142b83248291d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.712357:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40fc00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:1.0:1787823712.712360:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db4cb9ec/0x5d1142b83248291d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.712368:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db4cb9ec/0x5d1142b83248291d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.712377:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db4cb9ec/0x5d1142b83248291d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.712384:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db4cb9ec/0x5d1142b83248291d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.712398:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823712.712399:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823712.712401:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823712.712792:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823712.713037:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787823712.713662:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:0.0:1787823712.717620:0:15001:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787823712.717646:0:15001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000912e0012/0x5d1142b832482924 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.717668:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1787823712.717673:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787823712.717683:0:15001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000912e0012/0x5d1142b832482924 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.717698:0:15001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000912e0012/0x5d1142b832482924 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.717709:0:15001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000912e0012/0x5d1142b832482924 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.717716:0:15001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000912e0012/0x5d1142b832482924 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.717749:0:15001:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787823712.718015:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787823712.718024:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000912e0012/0x5d1142b832482924 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823712.718032:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40ea00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:3.0:1787823712.718037:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000912e0012/0x5d1142b832482924 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823712.718057:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000912e0012/0x5d1142b832482924 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823712.718081:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000912e0012/0x5d1142b832482924 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823712.718091:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000912e0012/0x5d1142b832482924 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823712.718111:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823712.718113:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823712.718115:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787823712.718530:0:15001:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787823712.718536:0:15001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d741ea82/0x5d1142b83248292b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.718547:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1787823712.718550:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787823712.718555:0:15001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d741ea82/0x5d1142b83248292b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.718565:0:15001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d741ea82/0x5d1142b83248292b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.718579:0:15001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d741ea82/0x5d1142b83248292b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.718586:0:15001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d741ea82/0x5d1142b83248292b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.725043:0:15001:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787823712.725806:0:15001:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787823712.725816:0:15001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000455794f8/0x5d1142b832482932 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.725833:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1787823712.725838:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787823712.725844:0:15001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000455794f8/0x5d1142b832482932 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.725860:0:15001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000455794f8/0x5d1142b832482932 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.725871:0:15001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000455794f8/0x5d1142b832482932 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.725879:0:15001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000455794f8/0x5d1142b832482932 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823712.728179:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787823712.728195:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d741ea82/0x5d1142b83248292b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823712.728208:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40fe00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:3.0:1787823712.728213:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d741ea82/0x5d1142b83248292b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823712.728224:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d741ea82/0x5d1142b83248292b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823712.728244:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d741ea82/0x5d1142b83248292b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823712.728273:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d741ea82/0x5d1142b83248292b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.728381:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787823712.728387:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000455794f8/0x5d1142b832482932 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.728395:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40f600 already unused, calling callback (ffffffffc1649440) 00010000:00010000:1.0:1787823712.728398:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000455794f8/0x5d1142b832482932 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.728406:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000455794f8/0x5d1142b832482932 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.728424:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000455794f8/0x5d1142b832482932 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.728432:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823712.728434:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823712.728437:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823712.736857:0:15001:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787823712.736876:0:15001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000455794f8/0x5d1142b832482932 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.737137:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787823712.739003:0:15001:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787823712.739017:0:15001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf01f109/0x5d1142b832482939 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.739037:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1787823712.739041:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787823712.739047:0:15001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf01f109/0x5d1142b832482939 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.739062:0:15001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf01f109/0x5d1142b832482939 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.739074:0:15001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf01f109/0x5d1142b832482939 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.739081:0:15001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf01f109/0x5d1142b832482939 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.739105:0:15001:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787823712.739594:0:15001:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787823712.739600:0:15001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008885472c/0x5d1142b832482940 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.739609:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1787823712.739612:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787823712.739616:0:15001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008885472c/0x5d1142b832482940 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.739625:0:15001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008885472c/0x5d1142b832482940 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.739633:0:15001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008885472c/0x5d1142b832482940 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.739640:0:15001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008885472c/0x5d1142b832482940 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.739988:0:15001:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787823712.740422:0:15001:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787823712.740429:0:15001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083e5076a/0x5d1142b832482947 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.740439:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1787823712.740443:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787823712.740448:0:15001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083e5076a/0x5d1142b832482947 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.740468:0:15001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083e5076a/0x5d1142b832482947 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.740478:0:15001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083e5076a/0x5d1142b832482947 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.740485:0:15001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083e5076a/0x5d1142b832482947 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.743497:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787823712.743512:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf01f109/0x5d1142b832482939 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.743526:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eeb800 already unused, calling callback (ffffffffc1649440) 00010000:00010000:2.0:1787823712.743531:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf01f109/0x5d1142b832482939 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.743558:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf01f109/0x5d1142b832482939 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.743584:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf01f109/0x5d1142b832482939 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.743592:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf01f109/0x5d1142b832482939 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.743673:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787823712.743678:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008885472c/0x5d1142b832482940 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.743686:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eeaa00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:2.0:1787823712.743689:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008885472c/0x5d1142b832482940 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.743696:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008885472c/0x5d1142b832482940 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.743706:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008885472c/0x5d1142b832482940 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.743713:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008885472c/0x5d1142b832482940 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.743736:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787823712.743740:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083e5076a/0x5d1142b832482947 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.743745:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eeb600 already unused, calling callback (ffffffffc1649440) 00010000:00010000:2.0:1787823712.743749:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083e5076a/0x5d1142b832482947 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.743784:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083e5076a/0x5d1142b832482947 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.743797:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083e5076a/0x5d1142b832482947 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823712.743804:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823712.743806:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823712.743808:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823712.747570:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823712.750991:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823712.751040:0:15001:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787823712.751054:0:15001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083e5076a/0x5d1142b832482947 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787823712.751704:0:15001:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787823712.751712:0:15001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6e8b871/0x5d1142b83248294e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.751725:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1787823712.751729:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787823712.751735:0:15001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6e8b871/0x5d1142b83248294e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.751748:0:15001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6e8b871/0x5d1142b83248294e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.751787:0:15001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6e8b871/0x5d1142b83248294e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.751794:0:15001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6e8b871/0x5d1142b83248294e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.751812:0:15001:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787823712.753053:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787823712.753065:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6e8b871/0x5d1142b83248294e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823712.753078:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eea600 already unused, calling callback (ffffffffc1649440) 00010000:00010000:3.0:1787823712.753082:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6e8b871/0x5d1142b83248294e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823712.753093:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6e8b871/0x5d1142b83248294e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823712.753113:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6e8b871/0x5d1142b83248294e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823712.753120:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6e8b871/0x5d1142b83248294e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823712.753140:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823712.753142:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823712.753143:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787823712.754494:0:15001:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787823712.754504:0:15001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6841e80/0x5d1142b832482955 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.754519:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1787823712.754523:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787823712.754529:0:15001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6841e80/0x5d1142b832482955 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.754542:0:15001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6841e80/0x5d1142b832482955 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.754551:0:15001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6841e80/0x5d1142b832482955 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.754558:0:15001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6841e80/0x5d1142b832482955 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.754642:0:15001:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787823712.757383:0:15001:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787823712.757397:0:15001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af23f5ab/0x5d1142b83248295c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.757416:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1787823712.757420:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787823712.757427:0:15001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af23f5ab/0x5d1142b83248295c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.757443:0:15001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af23f5ab/0x5d1142b83248295c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.757452:0:15001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af23f5ab/0x5d1142b83248295c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823712.757460:0:15001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af23f5ab/0x5d1142b83248295c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.763114:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787823712.763132:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6841e80/0x5d1142b832482955 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.763147:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eebe00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:0.0:1787823712.763151:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6841e80/0x5d1142b832482955 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.763163:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6841e80/0x5d1142b832482955 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.763187:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6841e80/0x5d1142b832482955 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.763195:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6841e80/0x5d1142b832482955 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.763217:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787823712.763221:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af23f5ab/0x5d1142b83248295c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.763236:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eebc00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:0.0:1787823712.763239:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af23f5ab/0x5d1142b83248295c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.763248:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af23f5ab/0x5d1142b83248295c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.763259:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af23f5ab/0x5d1142b83248295c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823712.763267:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823712.763268:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823712.763270:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823712.765264:0:15001:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787823712.765279:0:15001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af23f5ab/0x5d1142b83248295c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1787823712.765847:0:15001:0:(ofd_dev.c:1521:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:3.0:1787823712.766016:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a283c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14339:x1874668651904256:12345-0@lo:5:osp-pre-0-0.0 Request processed in 144653us (145022us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823712.766038:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787823712.766156:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823712.766243:0:14339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a281680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14339:1874668651904256:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787823712.766259:0:14339:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1787823712.766314:0:14339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0da40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14339:1874668651904384:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787823712.766353:0:14339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823712.766401:0:14339:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793516fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787823712.766454:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651904384 00000100:00100000:0.0:1787823712.766461:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651904384 00000100:00100000:0.0:1787823712.766508:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787823712.766517:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14339:x1874668651904384:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787823712.766560:0:15000:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:0.0:1787823712.784615:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14339:x1874668651904384:12345-0@lo:5:osp-pre-0-0.0 Request processed in 18092us (18254us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787823712.784629:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787823712.785169:0:14339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0da40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14339:1874668651904384:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787823712.785185:0:14339:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1787823713.130826:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823714.157490:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823715.179014:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823716.206546:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787823716.991098:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1787823716.991129:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:01000004:3.0:1787823717.046065:0:15716:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787823717.046070:0:15716:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1787823717.046199:0:15716:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e792ee55800 00000020:01000004:3.0:1787823717.046216:0:15716:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787823717.046229:0:15716:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1787823717.046243:0:15716:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8e7936a3b3a0) 00000020:00000080:3.0:1787823717.046262:0:15716:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787823717.064709:0:15716:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787823717.068148:0:15716:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1787823717.069251:0:15716:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787823717.069495:0:15716:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1787823717.069706:0:15716:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1787823717.070346:0:15716:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 439: rc = 0 00100000:10000000:1.0:1787823717.070469:0:15716:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 439: rc = 0 00100000:10000000:1.0:1787823717.070555:0:15716:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 439: rc = 0 00100000:10000000:1.0:1787823717.071826:0:15716:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 577: rc = 0 00100000:10000000:1.0:1787823717.072198:0:15716:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 577: rc = 0 00100000:10000000:1.0:1787823717.072440:0:15716:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 577: rc = 0 00100000:10000000:1.0:1787823717.072672:0:15716:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 577: rc = 0 00100000:10000000:1.0:1787823717.073310:0:15716:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 577: rc = 0 00100000:10000000:1.0:1787823717.073557:0:15716:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 577: rc = 0 00000020:00000080:1.0:1787823717.076258:0:15716:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1787823717.076272:0:15716:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787823717.076284:0:15716:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5d1142b83248296a 00000020:01000004:1.0:1787823717.076293:0:15716:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1787823717.076317:0:15716:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.135@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787823717.076320:0:15716:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.135@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787823717.076325:0:15716:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1787823717.076351:0:15716:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1787823717.076354:0:15716:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.135@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787823717.098320:0:15716:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.135@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787823717.098361:0:15716:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.135@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1787823717.098366:0:15716:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787823717.098367:0:15716:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787823717.098369:0:15716:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787823717.098370:0:15716:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787823717.098371:0:15716:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787823717.098376:0:15716:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787823717.098378:0:15716:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787823717.098380:0:15716:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787823717.098381:0:15716:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787823717.098384:0:15716:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1787823717.098387:0:15716:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787823717.098388:0:15716:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787823717.098389:0:15716:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787823717.098390:0:15716:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787823717.098391:0:15716:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787823717.098392:0:15716:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787823717.098393:0:15716:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787823717.098393:0:15716:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787823717.098394:0:15716:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787823717.098423:0:15716:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787823717.098443:0:15716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a280000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:15716:1874668651904512:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787823717.098531:0:15716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823717.098803:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651904512 00000100:00100000:0.0:1787823717.098811:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651904512 00000100:00100000:0.0:1787823717.098886:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787823717.098896:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79100ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+16:15716:x1874668651904512:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787823717.098925:0:14310:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787823717.098928:0:14310:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787823717.098932:0:14310:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787823717.101265:0:15716:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793516f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787823717.112288:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79100ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+16:15716:x1874668651904512:12345-0@lo:253:mount.lustre.0 Request processed in 13382us (13746us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823717.112304:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787823717.112388:0:15716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a280000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:15716:1874668651904512:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787823717.112404:0:15716:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787823717.112407:0:15716:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787823717.112409:0:15716:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787823717.112410:0:15716:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787823717.112412:0:15716:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787823717.112413:0:15716:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787823717.112414:0:15716:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787823717.112416:0:15716:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787823717.112418:0:15716:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787823717.112419:0:15716:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787823717.112440:0:15716:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e792ee55800 from lustre-OST0001 10000000:01000000:2.0:1787823717.112465:0:15716:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787823717.112468:0:15716:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787823717.112475:0:15716:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e792ea819d0 local copy 00010000:00010000:2.0:1787823717.112485:0:15716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b832482710 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832482717 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823717.112725:0:15716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a280000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:15716:1874668651904640:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787823717.113197:0:15716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823717.113268:0:15716:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793516fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787823717.113308:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651904640 00000100:00100000:2.0:1787823717.113314:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651904640 00000100:00100000:2.0:1787823717.113397:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787823717.113407:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79100ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+16:15716:x1874668651904640:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787823717.113678:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79100ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+16:15716:x1874668651904640:12345-0@lo:501:mount.lustre.0 Request processed in 272us (481us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787823717.113686:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787823717.113787:0:15716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a280000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:15716:1874668651904640:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787823717.113805:0:15716:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.135@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787823717.113975:0:15716:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.135@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787823717.113983:0:15716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b832482710 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832482717 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823717.113993:0:15716:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e7920eea800/0x5d1142b832482710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832482717 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787823717.114015:0:15716:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e792ee55800 10000000:01000000:0.0:1787823717.114020:0:15716:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787823717.114038:0:15716:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787823717.114041:0:15716:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787823717.114045:0:15716:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787823717.114047:0:15716:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787823717.114074:0:15716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a40fc00/0x5d1142b832482971 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823717.114083:0:15716:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e793a40fc00/0x5d1142b832482971 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823717.114092:0:15716:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e793a40fc00/0x5d1142b832482971 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823717.114130:0:15716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7802e10b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:15716:1874668651904768:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787823717.114164:0:15716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823717.114551:0:15716:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79046fdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787823717.114649:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651904768 00000100:00100000:3.0:1787823717.114655:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651904768 00000100:00100000:3.0:1787823717.114684:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787823717.114692:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79100efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+16:15716:x1874668651904768:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787823717.114702:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823717.114714:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e793a26cc00/0x5d1142b832482978 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b832482971 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823717.114745:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e793a26cc00/0x5d1142b832482978 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b832482971 expref: 17 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823717.114755:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e793a26cc00/0x5d1142b832482978 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832482971 expref: 17 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823717.114779:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a26cc00, rc 0) 00000100:00100000:3.0:1787823717.114934:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79100efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+17:15716:x1874668651904768:12345-0@lo:101:mount.lustre.0 Request processed in 243us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823717.114948:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787823717.115110:0:15716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7802e10b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:15716:1874668651904768:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787823717.115136:0:15716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e793a40fc00/0x5d1142b832482971 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832482978 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823717.115145:0:15716:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e793a40fc00/0x5d1142b832482971 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b832482978 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787823717.115723:0:15716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1787823717.117714:0:15716:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787823717.118271:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1787823717.118320:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1787823717.118355:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1787823717.118403:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1787823717.118442:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1787823717.118478:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1787823717.118545:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1787823717.118554:0:15716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1787823717.118697:0:15716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7802e10b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:15716:1874668651904896:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787823717.118791:0:15716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823717.118956:0:15716:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7909a44180 going to sleep for 11 seconds 00000100:00100000:2.0:1787823717.119161:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651904896 00000100:00100000:2.0:1787823717.119169:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651904896 00000100:00100000:2.0:1787823717.119219:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787823717.119228:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79100ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+17:15716:x1874668651904896:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787823717.119744:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79100ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+17:15716:x1874668651904896:12345-0@lo:501:mount.lustre.0 Request processed in 516us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823717.119752:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787823717.120241:0:15716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7802e10b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:15716:1874668651904896:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787823717.120284:0:15716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7802e10b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:15716:1874668651905024:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787823717.120329:0:15716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823717.120359:0:15716:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7909a44180 going to sleep for 11 seconds 00000100:00100000:1.0:1787823717.120411:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651905024 00000100:00100000:1.0:1787823717.120416:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651905024 00000100:00100000:1.0:1787823717.120453:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787823717.120461:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79100edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+17:15716:x1874668651905024:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787823717.121387:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79100edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+17:15716:x1874668651905024:12345-0@lo:503:mount.lustre.0 Request processed in 923us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823717.121397:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787823717.121466:0:15716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7802e10b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:15716:1874668651905024:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787823717.123439:0:15716:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787823717.123541:0:15716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea8e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:15716:1874668651905152:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787823717.123612:0:15716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823717.123711:0:15716:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79037f6540 going to sleep for 11 seconds 00000100:00100000:1.0:1787823717.123945:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651905152 00000100:00100000:1.0:1787823717.123953:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651905152 00000100:00100000:1.0:1787823717.124004:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787823717.124013:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79100ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+17:15716:x1874668651905152:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787823717.124408:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79100ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+17:15716:x1874668651905152:12345-0@lo:502:mount.lustre.0 Request processed in 396us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823717.124417:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787823717.124545:0:15716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea8e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:15716:1874668651905152:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787823717.124793:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1787823717.125082:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1787823717.125194:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1787823717.125246:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1787823717.125279:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1787823717.125306:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787823717.125352:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787823717.125387:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787823717.125433:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1787823717.125472:0:15716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea8e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:15716:1874668651905280:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787823717.125525:0:15716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823717.125569:0:15716:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79037f6540 going to sleep for 11 seconds 00000100:00100000:0.0:1787823717.125625:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651905280 00000100:00100000:0.0:1787823717.125631:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651905280 00000100:00100000:0.0:1787823717.125715:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787823717.125725:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793ad52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+17:15716:x1874668651905280:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787823717.125942:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793ad52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+17:15716:x1874668651905280:12345-0@lo:502:mount.lustre.0 Request processed in 219us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823717.125949:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787823717.126210:0:15716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea8e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:15716:1874668651905280:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787823717.126278:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1787823717.126290:0:15716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1787823717.127537:0:15717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787823717.127547:0:15717:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1787823717.127554:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787823717.127557:0:15717:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787823717.127573:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787823717.127587:0:15717:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8e7936a399d0) 00000020:00000080:3.0:1787823717.127607:0:15717:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787823717.127613:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787823717.127682:0:15717:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e792ee55800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787823717.127690:0:15717:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787823717.127696:0:15717:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5d1142b832482986 00010000:00010000:3.0:1787823717.132265:0:15717:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1787823717.132652:0:15717:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1787823717.134754:0:15717:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1787823717.136673:0:15717:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787823717.136684:0:15717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787823717.136690:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787823717.136693:0:15717:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787823717.136699:0:15717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787823717.136703:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787823717.136705:0:15717:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787823717.136708:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787823717.136710:0:15717:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787823717.136712:0:15717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787823717.136714:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787823717.136716:0:15717:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787823717.136718:0:15717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787823717.136721:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787823717.136722:0:15717:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787823717.136736:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787823717.137485:0:15717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787823717.137492:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787823717.137494:0:15717:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787823717.137499:0:15717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1787823717.139138:0:15716:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1787823717.139173:0:15716:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787823717.139196:0:15716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a40fc00/0x5d1142b832482971 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832482978 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823717.139208:0:15716:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e793a40fc00/0x5d1142b832482971 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832482978 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787823717.139215:0:15716:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e792ee55800 from 1 10000000:01000000:1.0:1787823717.139218:0:15716:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787823717.139252:0:15716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7920eeac00/0x5d1142b83248298d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823717.139260:0:15716:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e7920eeac00/0x5d1142b83248298d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823717.139275:0:15716:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e7920eeac00/0x5d1142b83248298d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823717.139299:0:15716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:15716:1874668651905408:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787823717.139369:0:15716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823717.140086:0:15716:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79037cd240 going to sleep for 11 seconds 00000100:00100000:3.0:1787823717.144184:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651905408 00000100:00100000:3.0:1787823717.144200:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651905408 00000100:00100000:3.0:1787823717.144260:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787823717.144272:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793ad50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+17:15716:x1874668651905408:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787823717.144291:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823717.144313:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e793a26c000/0x5d1142b832482994 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b83248298d expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823717.144345:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e793a26c000/0x5d1142b832482994 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b83248298d expref: 18 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823717.144357:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e793a26c000/0x5d1142b832482994 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b83248298d expref: 18 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823717.144368:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a26c000, rc 0) 00000100:00100000:3.0:1787823717.144455:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793ad50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+18:15716:x1874668651905408:12345-0@lo:101:mount.lustre.0 Request processed in 186us (5086us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823717.144462:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787823717.144938:0:15716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:15716:1874668651905408:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787823717.144965:0:15716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e7920eeac00/0x5d1142b83248298d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832482994 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823717.144975:0:15716:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e7920eeac00/0x5d1142b83248298d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b832482994 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787823717.146149:0:15716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1787823717.146792:0:15716:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787823717.147493:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1787823717.147546:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1787823717.147609:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1787823717.147618:0:15716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1787823717.147698:0:15716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7802e13840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:15716:1874668651905536:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787823717.148724:0:15716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823717.149244:0:15716:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7909a44300 going to sleep for 11 seconds 00000100:00100000:2.0:1787823717.157377:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651905536 00000100:00100000:2.0:1787823717.157394:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651905536 00000100:00100000:2.0:1787823717.157459:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787823717.157469:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793ad52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+18:15716:x1874668651905536:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787823717.157843:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793ad52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+18:15716:x1874668651905536:12345-0@lo:501:mount.lustre.0 Request processed in 374us (9120us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823717.157852:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787823717.158273:0:15716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7802e13840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:15716:1874668651905536:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787823717.158326:0:15716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7802e13840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:15716:1874668651905664:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787823717.158377:0:15716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823717.158417:0:15716:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7909a44300 going to sleep for 11 seconds 00000100:00100000:3.0:1787823717.158460:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651905664 00000100:00100000:3.0:1787823717.158465:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651905664 00000100:00100000:3.0:1787823717.158505:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787823717.158513:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793ad53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+18:15716:x1874668651905664:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787823717.158834:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793ad53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+18:15716:x1874668651905664:12345-0@lo:503:mount.lustre.0 Request processed in 322us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823717.158840:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787823717.158973:0:15716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7802e13840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:15716:1874668651905664:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787823717.159568:0:15716:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787823717.159638:0:15716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7802e13840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:15716:1874668651905792:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787823717.159683:0:15716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823717.159722:0:15716:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7909a44300 going to sleep for 11 seconds 00000100:00100000:2.0:1787823717.159816:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651905792 00000100:00100000:2.0:1787823717.159821:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651905792 00000100:00100000:2.0:1787823717.159848:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787823717.159855:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793ad53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+18:15716:x1874668651905792:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787823717.160413:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793ad53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+18:15716:x1874668651905792:12345-0@lo:502:mount.lustre.0 Request processed in 557us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823717.160421:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787823717.160749:0:15716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7802e13840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:15716:1874668651905792:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787823717.161351:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1787823717.161424:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1787823717.161467:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1787823717.161498:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1787823717.161526:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1787823717.161568:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1787823717.162341:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1787823717.162383:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1787823717.162430:0:15716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7802e13840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:15716:1874668651905920:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787823717.162502:0:15716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823717.162596:0:15716:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7909a44300 going to sleep for 11 seconds 00000100:00100000:1.0:1787823717.173673:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651905920 00000100:00100000:1.0:1787823717.173690:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651905920 00000100:00100000:1.0:1787823717.173799:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787823717.174490:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f98f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+18:15716:x1874668651905920:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787823717.174858:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f98f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+18:15716:x1874668651905920:12345-0@lo:502:mount.lustre.0 Request processed in 1048us (12354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823717.174878:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787823717.175050:0:15716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7802e13840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:15716:1874668651905920:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787823717.175599:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1787823717.175620:0:15716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1787823717.177334:0:15721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787823717.177347:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787823717.177350:0:15721:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787823717.177356:0:15721:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e792ee55800 00000020:00000080:0.0:1787823717.177358:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787823717.177365:0:15721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787823717.177367:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787823717.177368:0:15721:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787823717.177370:0:15721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787823717.177373:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787823717.177374:0:15721:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787823717.177378:0:15721:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e792ee55800 00000020:00000080:0.0:1787823717.177380:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787823717.177432:0:15721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787823717.177435:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787823717.177436:0:15721:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787823717.177438:0:15721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787823717.177441:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787823717.177442:0:15721:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787823717.177459:0:15721:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e792ee55800 00000020:00000080:0.0:1787823717.177461:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787823717.177497:0:15721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787823717.177500:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787823717.177502:0:15721:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787823717.177505:0:15721:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1787823717.178695:0:15716:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787823717.178737:0:15716:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787823717.178754:0:15716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e7920eeac00/0x5d1142b83248298d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832482994 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823717.178789:0:15716:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e7920eeac00/0x5d1142b83248298d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832482994 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787823717.178847:0:15716:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787823717.178850:0:15716:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e792ee55800 10000000:01000000:2.0:1787823717.178854:0:15716:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e792ee55800 10000000:01000000:2.0:1787823717.178859:0:15716:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787823717.178865:0:15716:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e792ee55800 from 1 10000000:01000000:2.0:1787823717.178877:0:15716:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787823717.178911:0:15716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e79358d2600/0x5d1142b83248299b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823717.178920:0:15716:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e79358d2600/0x5d1142b83248299b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823717.178931:0:15716:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e79358d2600/0x5d1142b83248299b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823717.178954:0:15716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a281680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:15716:1874668651906048:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787823717.179046:0:15716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823717.179094:0:15716:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7901515600 going to sleep for 11 seconds 00000100:00100000:3.0:1787823717.179365:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651906048 00000100:00100000:3.0:1787823717.179372:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651906048 00000100:00100000:3.0:1787823717.179409:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787823717.179417:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f98d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+18:15716:x1874668651906048:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787823717.179430:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823717.179442:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e793a26ca00/0x5d1142b8324829a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b83248299b expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823717.179464:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e793a26ca00/0x5d1142b8324829a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b83248299b expref: 19 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823717.179475:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e793a26ca00/0x5d1142b8324829a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b83248299b expref: 19 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823717.179483:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a26ca00, rc 0) 00000100:00100000:3.0:1787823717.179521:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f98d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+19:15716:x1874668651906048:12345-0@lo:101:mount.lustre.0 Request processed in 105us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823717.179528:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787823717.179697:0:15716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a281680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:15716:1874668651906048:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787823717.179712:0:15716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e79358d2600/0x5d1142b83248299b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324829a2 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823717.179722:0:15716:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e79358d2600/0x5d1142b83248299b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b8324829a2 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787823717.183307:0:15716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1787823717.193384:0:15716:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787823717.193679:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787823717.193724:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787823717.193797:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787823717.197281:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787823717.197349:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787823717.197401:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787823717.197437:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787823717.197474:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787823717.197525:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787823717.197558:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787823717.197591:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787823717.197647:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787823717.197685:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787823717.197719:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787823717.198276:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787823717.198317:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787823717.198350:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787823717.198400:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787823717.198438:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787823717.198472:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787823717.198534:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787823717.198569:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787823717.198602:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787823717.198650:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787823717.198686:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1787823717.198720:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1787823717.198806:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1787823717.198856:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1787823717.198891:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1787823717.198940:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1787823717.198993:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1787823717.199027:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1787823717.199060:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1787823717.199107:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1787823717.199143:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1787823717.199189:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1787823717.199225:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1787823717.199322:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1787823717.199330:0:15716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1787823717.199444:0:15716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a281680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:15716:1874668651906176:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787823717.199514:0:15716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823717.199576:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651906176 00000100:00100000:2.0:1787823717.199583:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651906176 00000100:00100000:2.0:1787823717.199631:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787823717.199639:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f98cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+19:15716:x1874668651906176:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787823717.199936:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f98cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+19:15716:x1874668651906176:12345-0@lo:501:mount.lustre.0 Request processed in 296us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823717.199944:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787823717.200008:0:15716:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7901515600 going to sleep for 11 seconds 00000100:00100000:2.0:1787823717.200029:0:15716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a281680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:15716:1874668651906176:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787823717.200067:0:15716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a281680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:15716:1874668651906304:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787823717.200105:0:15716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823717.200129:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651906304 00000100:00100000:2.0:1787823717.200133:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651906304 00000100:00100000:2.0:1787823717.200156:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787823717.200162:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f98c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+19:15716:x1874668651906304:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787823717.200426:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f98c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+19:15716:x1874668651906304:12345-0@lo:503:mount.lustre.0 Request processed in 264us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823717.200433:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787823717.200463:0:15716:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7901515600 going to sleep for 11 seconds 00000100:00100000:2.0:1787823717.200474:0:15716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a281680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:15716:1874668651906304:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787823717.201161:0:15716:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787823717.201223:0:15716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a281680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:15716:1874668651906432:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787823717.201267:0:15716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823717.201300:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651906432 00000100:00100000:2.0:1787823717.201304:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651906432 00000100:00100000:2.0:1787823717.201333:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787823717.201339:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f98e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+19:15716:x1874668651906432:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787823717.201551:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f98e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+19:15716:x1874668651906432:12345-0@lo:502:mount.lustre.0 Request processed in 211us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823717.201558:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787823717.201591:0:15716:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79037986c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787823717.201606:0:15716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a281680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:15716:1874668651906432:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787823717.217097:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1787823717.217193:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1787823717.217238:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1787823717.217303:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1787823717.217340:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1787823717.217401:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1787823717.217439:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1787823717.217473:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1787823717.217521:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1787823717.217558:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1787823717.217603:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1787823717.217646:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1787823717.217676:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1787823717.217704:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1787823717.217782:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1787823717.217821:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1787823717.217852:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1787823717.217893:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1787823717.217929:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1787823717.217962:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1787823717.218009:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1787823717.218059:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1787823717.218093:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1787823717.218136:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1787823717.218171:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1787823717.218203:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1787823717.218245:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1787823717.218279:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1787823717.218310:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1787823717.218355:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1787823717.218390:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1787823717.218423:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1787823717.218457:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1787823717.218505:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1787823717.218542:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1787823717.218603:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1787823717.218641:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1787823717.218696:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1787823717.218787:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1787823717.218826:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1787823717.218877:0:15716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a281680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:15716:1874668651906560:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787823717.218958:0:15716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823717.219008:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651906560 00000100:00100000:2.0:1787823717.219014:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651906560 00000100:00100000:2.0:1787823717.219059:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787823717.219068:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f98e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+19:15716:x1874668651906560:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787823717.219261:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f98e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+19:15716:x1874668651906560:12345-0@lo:502:mount.lustre.0 Request processed in 193us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823717.219269:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787823717.219321:0:15716:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79037986c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787823717.219341:0:15716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a281680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:15716:1874668651906560:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787823717.219401:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1787823717.219410:0:15716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00010000:00010000:3.0:1787823717.227929:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787823717.231953:0:15725:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787823717.231971:0:15725:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8e7936e6cd70) 00000020:00000080:0.0:1787823717.231994:0:15725:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1787823717.232082:0:15725:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e792ee55800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787823717.232087:0:15725:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e792ee55800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787823717.232089:0:15725:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e792ee55800 3 00010000:00080000:0.0:1787823717.232123:0:15725:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e7908d98000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.135@tcp at head 00010000:00010000:0.0:1787823717.233666:0:15725:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1787823717.233914:0:15725:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787823717.233949:0:15725:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787823717.233963:0:15725:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5d1142b8324829b0 00000100:00080000:0.0:1787823717.233972:0:15725:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787823717.233978:0:15725:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e7908d98000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:0.0:1787823717.234015:0:15725:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e7802e13840 x1874668651906688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787823717.234052:0:15725:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787823717.234282:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7802e13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1874668651906688:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787823717.234362:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787823717.234447:0:12985:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787823717.234452:0:12985:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787823717.234454:0:12985:0:(import.c:65:import_set_state_nolock()) ffff8e7918291800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787823717.234459:0:12985:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 453 00000100:00080000:2.0:1787823717.234465:0:12985:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787823717.234469:0:12985:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e7918291800 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:2.0:1787823717.234483:0:12985:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e793a280780 x1874668651906944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787823717.234567:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651906688 00000100:00100000:2.0:1787823717.234573:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651906688 00000100:00100000:2.0:1787823717.234609:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787823717.234616:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a281680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1874668651906688:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787823717.234639:0:14318:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 458 last 0 00000020:00000080:2.0:1787823717.234669:0:14318:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5d1142b8324829b7 00000004:00100000:2.0:1787823717.234685:0:14318:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787823717.234717:0:14318:0:(import.c:65:import_set_state_nolock()) ffff8e793a421000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787823717.236548:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a281680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874668651906688:12345-0@lo:38:llog_process_th.0 Request processed in 1924us (2180us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823717.236562:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787823717.236662:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a281e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874668651907072:0@lo:400:kworker.0 00000100:00100000:2.0:1787823717.236698:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823717.236737:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787823717.236746:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a282d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651906816:0@lo:400:kworker.0 00000100:00100000:2.0:1787823717.236788:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823717.236822:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a280780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874668651906944:0@lo:8:kworker.0 00000100:00100000:2.0:1787823717.236846:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787823717.236881:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7802e13840 x1874668651906688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787823727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823717.236892:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787823717.236901:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1787823717.236909:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787823717.236914:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787823717.236917:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8e7908d98000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787823717.236931:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7802e13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1874668651906688:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787823717.236954:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787823717.236964:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874668651907200:0@lo:400:kworker.0 00000100:00100000:2.0:1787823717.236991:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823717.237021:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651907072 00000100:00100000:2.0:1787823717.237026:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651907072 00000100:00100000:2.0:1787823717.237059:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651907200 00000100:00100000:2.0:1787823717.237062:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651907200 00000100:00100000:2.0:1787823717.237088:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787823717.237096:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874668651907072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823717.237138:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874668651907072:12345-0@lo:400:kworker.0 Request processed in 43us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823717.237144:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787823717.237157:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787823717.237163:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7920d61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874668651907200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823717.237192:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7920d61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874668651907200:12345-0@lo:400:kworker.0 Request processed in 29us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823717.237197:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787823717.237220:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651906816 00000100:00100000:2.0:1787823717.237224:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651906816 00000100:00100000:2.0:1787823717.237247:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651906944 00000100:00100000:2.0:1787823717.237250:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651906944 00000100:00100000:2.0:1787823717.237260:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787823717.237265:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a280000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651906816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823717.237294:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a280000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651906816:12345-0@lo:400:kworker.0 Request processed in 28us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823717.237299:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787823717.237317:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787823717.237321:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a2821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1874668651906944:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787823717.237365:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a2821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1874668651906944:12345-0@lo:8:kworker.0 Request processed in 42us (518us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787823717.237371:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787823717.237390:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787823717.237394:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787823717.237413:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787823717.237423:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a282d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651906816:0@lo:400:kworker.0 00010000:00080000:2.0:1787823717.237434:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e793a281e00 x1874668651907072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787823733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823717.237444:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a281e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874668651907072:0@lo:400:kworker.0 00010000:00080000:2.0:1787823717.237470:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e793a283480 x1874668651907200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787823733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823717.237478:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874668651907200:0@lo:400:kworker.0 00000100:00100000:2.0:1787823717.237498:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787823717.237502:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8e7918291800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787823717.237505:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787823717.237508:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a280780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874668651906944:0@lo:8:kworker.0 00000040:00080000:0.0:1787823717.238906:0:15725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1787823717.239161:0:15716:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787823717.239194:0:15716:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787823717.239214:0:15716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e79358d2600/0x5d1142b83248299b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324829a2 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823717.239225:0:15716:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e79358d2600/0x5d1142b83248299b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324829a2 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787823717.239278:0:15716:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787823717.239281:0:15716:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787823717.239282:0:15716:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787823717.239284:0:15716:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787823717.239285:0:15716:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787823717.239286:0:15716:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787823717.239288:0:15716:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787823717.239290:0:15716:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787823717.239292:0:15716:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787823717.239297:0:15716:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1787823717.239299:0:15716:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787823717.239300:0:15716:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787823717.239301:0:15716:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787823717.239302:0:15716:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787823717.239304:0:15716:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787823717.239305:0:15716:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787823717.239306:0:15716:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787823717.239307:0:15716:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787823717.239308:0:15716:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787823717.239335:0:15716:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787823717.239357:0:15716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7920d63c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:15716:1874668651907328:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787823717.239421:0:15716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823717.239455:0:15716:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79037986c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787823717.239475:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651907328 00000100:00100000:2.0:1787823717.239482:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651907328 00000100:00100000:2.0:1787823717.239519:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787823717.239527:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79182b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+19:15716:x1874668651907328:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787823717.239554:0:14310:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787823717.239569:0:14310:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787823717.277138:0:14310:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787823717.277160:0:14310:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787823717.278692:0:14332:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787823717.278702:0:14332:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787823717.278724:0:14332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e79358d2c00/0x5d1142b8324829be lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823717.278856:0:14332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e793a26d000/0x5d1142b832482891 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b83248288a expref: 19 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823717.278872:0:14332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e79358d2c00/0x5d1142b8324829be lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823717.278914:0:14332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e793a26d000/0x5d1142b832482891 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d1142b83248288a expref: 19 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823717.278929:0:14332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e793a26d000/0x5d1142b832482891 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d1142b83248288a expref: 19 pid: 14311 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823717.278944:0:14332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a280780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14332:1874668651907456:0@lo:104: 00000100:00100000:2.0:1787823717.279009:0:14332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823717.279047:0:14332:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793b31f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787823717.279231:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651907456 00000100:00100000:1.0:1787823717.279239:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651907456 00000100:00100000:1.0:1787823717.279297:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787823717.279308:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a283480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+3:14332:x1874668651907456:12345-0@lo:104: 00010000:00010000:1.0:1787823717.279323:0:14300:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff8e793a40ec00/0x5d1142b83248288a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b832482891 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823717.279379:0:14300:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787823717.279386:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a283480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+3:14332:x1874668651907456:12345-0@lo:104: Request processed in 81us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823717.279392:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787823717.279501:0:14332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a280780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14332:1874668651907456:0@lo:104: 00010000:00010000:2.0:1787823717.279521:0:14332:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e79358d2c00/0x5d1142b8324829be lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823717.279663:0:15517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787823717.279670:0:15517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e793a40ec00/0x5d1142b83248288a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b832482891 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823717.279678:0:15517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40ec00 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:0.0:1787823717.279683:0:15517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e793a40ec00/0x5d1142b83248288a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d1142b832482891 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823717.279700:0:15517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e793a40ec00/0x5d1142b83248288a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d1142b832482891 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787823717.279708:0:15517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e793a40ec00/0x5d1142b83248288a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d1142b832482891 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787823717.279714:0:15517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787823717.279787:0:15517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e793a40ec00/0x5d1142b83248288a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832482891 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823717.279795:0:15517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787823717.279814:0:15517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e793a40ec00/0x5d1142b83248288a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832482891 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823717.279820:0:15517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e793a40ec00/0x5d1142b83248288a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832482891 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823717.279835:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823717.279837:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823717.279838:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823717.279990:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7802e11a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b00b7bac-c389-4a58-8ac8-b4f04764fb77:3308:1874668651907584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787823717.280026:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823717.280157:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651907584 00000100:00100000:0.0:1787823717.280163:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651907584 00010000:00010000:0.0:1787823717.280188:0:14303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e793a26d000/0x5d1142b832482891 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b83248288a expref: 20 pid: 14311 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823717.280217:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787823717.280224:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+20:3308:x1874668651907584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787823717.280235:0:14303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787823717.280241:0:14303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e793a26d000/0x5d1142b832482891 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b83248288a expref: 20 pid: 14311 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823717.284070:0:14303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e793a26d000/0x5d1142b832482891 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d1142b83248288a expref: 20 pid: 14311 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823717.284097:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e793a26d000/0x5d1142b832482891 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d1142b83248288a expref: 20 pid: 14311 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823717.284116:0:14303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e79358d2c00/0x5d1142b8324829be lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823717.284124:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e79358d2c00/0x5d1142b8324829be lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787823717.284146:0:14303:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005826509s 00010000:00010000:0.0:1787823717.284151:0:14303:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e79358d2c00/0x5d1142b8324829be lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823717.284157:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e79358d2c00/0x5d1142b8324829be lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823717.284164:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e79358d2c00/0x5d1142b8324829be lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823717.284170:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e79358d2c00/0x5d1142b8324829be lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823717.284177:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d2c00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:0.0:1787823717.284181:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e79358d2c00/0x5d1142b8324829be lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823717.284188:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e79358d2c00/0x5d1142b8324829be lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823717.284225:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e79358d2c00/0x5d1142b8324829be lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823717.284237:0:14303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787823717.284320:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+19:3308:x1874668651907584:12345-0@lo:103:ldlm_bl.0 Request processed in 4095us (4291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823717.284331:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1787823717.284490:0:14332:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e79358d2c00/0x5d1142b8324829be lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823717.284500:0:14332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e79358d2c00/0x5d1142b8324829be lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823717.284506:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e79358d2c00/0x5d1142b8324829be lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823717.284646:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7802e11a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b00b7bac-c389-4a58-8ac8-b4f04764fb77:3308:1874668651907584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787823717.289364:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79182b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+18:15716:x1874668651907328:12345-0@lo:253:mount.lustre.0 Request processed in 49826us (49932us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823717.289381:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787823717.289494:0:15716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7920d63c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b00b7bac-c389-4a58-8ac8-b4f04764fb77:15716:1874668651907328:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787823717.289525:0:15716:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787823717.289529:0:15716:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787823717.289531:0:15716:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787823717.289532:0:15716:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787823717.289533:0:15716:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787823717.289535:0:15716:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787823717.289536:0:15716:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787823717.289538:0:15716:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787823717.289540:0:15716:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787823717.289541:0:15716:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787823717.289557:0:15716:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787823717.293365:0:15716:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787823717.293576:0:15716:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787823717.294129:0:15716:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787823717.294288:0:15716:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787823717.294439:0:15716:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787823717.294603:0:15716:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787823717.295591:0:15716:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1787823717.349999:0:15716:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787823717.350013:0:15716:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787823717.350052:0:15716:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787823717.350109:0:15716:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.135@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787823717.350124:0:15716:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787823717.350155:0:15716:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:1.0:1787823717.868472:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a280780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651907712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787823717.868547:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823717.868742:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651907712 00000100:00100000:2.0:1787823717.868751:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651907712 00000100:00100000:2.0:1787823717.868831:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787823717.868840:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651907712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787823717.868888:0:15003:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787823717.868937:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651907712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823717.868944:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787823717.868994:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a280780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651907712:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787823718.250276:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787823719.274876:0:14313:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787823719.274884:0:14313:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e79358bc000 from 8 10000000:01000000:3.0:1787823719.274890:0:14313:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787823719.274936:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a26dc00/0x5d1142b8324829c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823719.274948:0:14313:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e793a26dc00/0x5d1142b8324829c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823719.274959:0:14313:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e793a26dc00/0x5d1142b8324829c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823719.274985:0:14313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea8f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14313:1874668651907840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787823719.275056:0:14313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823719.275105:0:14313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908c15900 going to sleep for 11 seconds 00010000:00010000:3.0:1787823719.275122:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823719.275193:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651907840 00000100:00100000:1.0:1787823719.275201:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651907840 00000100:00100000:1.0:1787823719.275258:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787823719.275268:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79182ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+18:14313:x1874668651907840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787823719.275281:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823719.275294:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7920eebc00/0x5d1142b8324829cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b8324829c5 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823719.275316:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7920eebc00/0x5d1142b8324829cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b8324829c5 expref: 19 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823719.275328:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7920eebc00/0x5d1142b8324829cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b8324829c5 expref: 19 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823719.275337:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7920eebc00, rc 0) 00000100:00100000:1.0:1787823719.275375:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79182ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+19:14313:x1874668651907840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823719.275382:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787823719.275683:0:14313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea8f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14313:1874668651907840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787823719.275698:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e793a26dc00/0x5d1142b8324829c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324829cc expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823719.275718:0:14313:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e793a26dc00/0x5d1142b8324829c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b8324829cc expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823719.275799:0:14313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ea8f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14313:1874668651907968:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787823719.275841:0:14313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823719.275866:0:14313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908c15900 going to sleep for 11 seconds 00000100:00100000:2.0:1787823719.275952:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651907968 00000100:00100000:2.0:1787823719.275957:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651907968 00000100:00100000:2.0:1787823719.275990:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787823719.275998:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79182b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+19:14313:x1874668651907968:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787823719.276011:0:14310:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787823719.276025:0:14310:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787823719.276028:0:14310:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1787823719.276108:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79182b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+19:14313:x1874668651907968:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 111us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823719.276114:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787823719.276198:0:14313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ea8f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14313:1874668651907968:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787823719.276254:0:14313:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787823719.276261:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a26dc00/0x5d1142b8324829c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324829cc expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823719.276269:0:14313:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e793a26dc00/0x5d1142b8324829c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b8324829cc expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787823719.658488:0:14348:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787823720.304140:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823721.325568:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823722.345920:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787823722.473950:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787823722.473957:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787823722.473962:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e7918291800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787823722.473975:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e7918291800 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:2.0:1787823722.474001:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e7920d63c00 x1874668651908352/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787823722.474078:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a282d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b00b7bac-c389-4a58-8ac8-b4f04764fb77:3306:1874668651908096:0@lo:400:kworker.0 00000100:00100000:2.0:1787823722.474154:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823722.474205:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a0ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874668651908736:0@lo:400:kworker.0 00000100:00100000:2.0:1787823722.474236:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823722.474260:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787823722.474266:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a0ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874668651908608:0@lo:400:kworker.0 00000100:00100000:2.0:1787823722.474289:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823722.474344:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a0ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874668651908480:0@lo:400:kworker.0 00000100:00100000:2.0:1787823722.474392:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823722.474415:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787823722.474420:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a280780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651908224:0@lo:400:kworker.0 00000100:00100000:2.0:1787823722.474450:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823722.474484:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7920d63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874668651908352:0@lo:8:kworker.0 00000100:00100000:2.0:1787823722.474511:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823722.474548:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651908096 00000100:00100000:2.0:1787823722.474556:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651908096 00000100:00100000:2.0:1787823722.474614:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787823722.474624:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79182b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+19:3306:x1874668651908096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823722.474812:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79182b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+19:3306:x1874668651908096:12345-0@lo:400:kworker.0 Request processed in 189us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823722.474820:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787823722.474858:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651908736 00000100:00100000:2.0:1787823722.474862:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651908736 00000100:00100000:2.0:1787823722.474902:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651908608 00000100:00100000:2.0:1787823722.474906:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651908608 00000100:00100000:2.0:1787823722.474924:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651908480 00000100:00100000:2.0:1787823722.474927:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651908480 00000100:00100000:2.0:1787823722.474946:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787823722.474953:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874668651908736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823722.474997:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874668651908736:12345-0@lo:400:kworker.0 Request processed in 44us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823722.475004:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787823722.475020:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787823722.475026:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874668651908608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823722.475070:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874668651908608:12345-0@lo:400:kworker.0 Request processed in 44us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823722.475077:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787823722.475094:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787823722.475101:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874668651908480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823722.475134:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874668651908480:12345-0@lo:400:kworker.0 Request processed in 33us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823722.475140:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787823722.475167:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651908224 00000100:00100000:2.0:1787823722.475171:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651908224 00000100:00100000:2.0:1787823722.475200:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651908352 00000100:00100000:2.0:1787823722.475204:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651908352 00000100:00100000:2.0:1787823722.475218:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787823722.475226:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0ef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651908224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823722.475263:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0ef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651908224:12345-0@lo:400:kworker.0 Request processed in 38us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823722.475269:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787823722.475281:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787823722.475285:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1874668651908352:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787823722.475308:0:15002:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:2.0:1787823722.475334:0:15002:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d1142b8324829d3 00002000:00100000:2.0:1787823722.475348:0:15002:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8e793a7ff800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787823722.475352:0:15002:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787823722.475355:0:15002:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787823722.475954:0:15002:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787823722.475980:0:15002:0:(import.c:65:import_set_state_nolock()) ffff8e793a7fd800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787823722.476044:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1874668651908352:12345-0@lo:8:kworker.0 Request processed in 757us (1532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823722.476052:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1787823722.476553:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787823722.476559:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787823722.476782:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a280780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651908224:0@lo:400:kworker.0 00010000:00080000:2.0:1787823722.476802:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e793a0ede00 x1874668651908480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787823738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823722.476813:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a0ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874668651908480:0@lo:400:kworker.0 00010000:00080000:2.0:1787823722.476849:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e793a0ed680 x1874668651908608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787823738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823722.476857:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a0ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874668651908608:0@lo:400:kworker.0 00000100:00100000:2.0:1787823722.476867:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a282d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b00b7bac-c389-4a58-8ac8-b4f04764fb77:3306:1874668651908096:0@lo:400:kworker.0 00010000:00080000:2.0:1787823722.476877:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e793a0ec780 x1874668651908736/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787823738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787823722.476884:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a0ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874668651908736:0@lo:400:kworker.0 00010000:00080000:0.0:1787823722.477441:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7920d63c00 x1874668651908352/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787823747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787823722.477458:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787823722.477466:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787823722.477472:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787823722.477476:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8e7918291800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787823722.477490:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787823722.477496:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7920d63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874668651908352:0@lo:8:kworker.0 00000004:00080000:1.0:1787823722.479138:0:14341:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:1.0:1787823722.479165:0:14341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0e1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14341:1874668651908992:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787823722.479243:0:14341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823722.479272:0:14341:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7910029180 going to sleep for 11 seconds 00000100:00100000:1.0:1787823722.479289:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651908864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787823722.479315:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823722.479351:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651908864 00000100:00100000:1.0:1787823722.479358:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651908864 00000100:00100000:1.0:1787823722.479409:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787823722.479418:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874668651908864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787823722.479461:0:15003:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787823722.479505:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874668651908864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823722.479513:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787823722.479550:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7922a0f480 x1874668651908864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787823738 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787823722.479569:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651908864:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787823722.479589:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787823722.479749:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651908992 00000100:00100000:1.0:1787823722.479754:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651908992 00000100:00100000:1.0:1787823722.479814:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787823722.479821:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14341:x1874668651908992:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787823722.485643:0:15002:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1787823722.485654:0:15002:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1787823722.485659:0:15002:0:(ofd_dev.c:1494:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00000004:00080000:2.0:1787823722.486206:0:14340:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787823722.486582:0:14340:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 463340821722ns, next at 0ns, rc = 0 00002000:00010000:1.0:1787823722.500244:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787823722.500258:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083e5076a/0x5d1142b8324829da lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.501744:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1787823722.501752:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787823722.501841:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083e5076a/0x5d1142b8324829da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.501871:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083e5076a/0x5d1142b8324829da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.501902:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083e5076a/0x5d1142b8324829da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.501909:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083e5076a/0x5d1142b8324829da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.501942:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787823722.501969:0:15517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787823722.502558:0:15517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083e5076a/0x5d1142b8324829da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.502573:0:15517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eeb600 already unused, calling callback (ffffffffc1649440) 00010000:00010000:1.0:1787823722.502578:0:15517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083e5076a/0x5d1142b8324829da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.502588:0:15517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083e5076a/0x5d1142b8324829da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.502609:0:15517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083e5076a/0x5d1142b8324829da lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.502755:0:15517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083e5076a/0x5d1142b8324829da lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.503923:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823722.505867:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823722.505873:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787823722.506806:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787823722.506819:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c53dacce/0x5d1142b8324829e1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.506902:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=463s v=(0 0) 00010000:00010000:2.0:1787823722.506917:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823722.506925:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c53dacce/0x5d1142b8324829e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.506944:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c53dacce/0x5d1142b8324829e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.506956:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c53dacce/0x5d1142b8324829e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.506965:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c53dacce/0x5d1142b8324829e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.506985:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787823722.506998:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787823722.507005:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c53dacce/0x5d1142b8324829e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.507013:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3e00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:2.0:1787823722.507019:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c53dacce/0x5d1142b8324829e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.507028:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c53dacce/0x5d1142b8324829e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.507044:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c53dacce/0x5d1142b8324829e1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.507063:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c53dacce/0x5d1142b8324829e1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.507083:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823722.507087:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823722.507090:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787823722.521821:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787823722.521836:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b8324829e8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.521854:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=463s v=(0 0) 00010000:00010000:2.0:1787823722.521859:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823722.521866:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b8324829e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.521882:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b8324829e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.523565:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b8324829e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.523582:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b8324829e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.523619:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787823722.523967:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787823722.523975:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b8324829e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823722.523985:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3c00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:0.0:1787823722.523990:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b8324829e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823722.524000:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b8324829e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823722.524041:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b8324829e8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823722.524050:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b8324829e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823722.524351:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823722.524353:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823722.524355:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787823722.525776:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787823722.525795:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a2b66f8/0x5d1142b8324829ef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.525810:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=463s v=(0 0) 00010000:00010000:2.0:1787823722.525815:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823722.525822:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a2b66f8/0x5d1142b8324829ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.525836:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a2b66f8/0x5d1142b8324829ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.525848:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a2b66f8/0x5d1142b8324829ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.525856:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a2b66f8/0x5d1142b8324829ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.525875:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787823722.525888:0:15517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787823722.525905:0:15517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a2b66f8/0x5d1142b8324829ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.525913:0:15517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3400 already unused, calling callback (ffffffffc1649440) 00010000:00010000:2.0:1787823722.525919:0:15517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a2b66f8/0x5d1142b8324829ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.525927:0:15517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a2b66f8/0x5d1142b8324829ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.525951:0:15517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a2b66f8/0x5d1142b8324829ef lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.525958:0:15517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a2b66f8/0x5d1142b8324829ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.525974:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823722.525976:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823722.525978:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787823722.526397:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787823722.526404:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005afb6609/0x5d1142b8324829f6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.526413:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=463s v=(0 0) 00010000:00010000:2.0:1787823722.526417:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823722.526422:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005afb6609/0x5d1142b8324829f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.526431:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005afb6609/0x5d1142b8324829f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.526440:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005afb6609/0x5d1142b8324829f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.526448:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005afb6609/0x5d1142b8324829f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.526475:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787823722.526484:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787823722.526489:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005afb6609/0x5d1142b8324829f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.526496:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3600 already unused, calling callback (ffffffffc1649440) 00010000:00010000:2.0:1787823722.526499:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005afb6609/0x5d1142b8324829f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.526508:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005afb6609/0x5d1142b8324829f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.526520:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005afb6609/0x5d1142b8324829f6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.526528:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005afb6609/0x5d1142b8324829f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.526542:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823722.526543:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823722.526545:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787823722.526971:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787823722.526978:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b8324829fd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.526987:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=463s v=(0 0) 00010000:00010000:2.0:1787823722.526997:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823722.527002:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b8324829fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.527012:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b8324829fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.527020:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b8324829fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.527027:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b8324829fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.527046:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787823722.527058:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787823722.527062:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b8324829fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.527070:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d2c00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:2.0:1787823722.527073:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b8324829fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.527081:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b8324829fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.527092:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b8324829fd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.527113:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b8324829fd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.527127:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823722.527134:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823722.527136:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787823722.527544:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787823722.527552:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f552a1d1/0x5d1142b832482a04 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.527563:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=463s v=(0 0) 00010000:00010000:2.0:1787823722.527566:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823722.527571:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f552a1d1/0x5d1142b832482a04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.527581:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f552a1d1/0x5d1142b832482a04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.527590:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f552a1d1/0x5d1142b832482a04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.527597:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f552a1d1/0x5d1142b832482a04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.527613:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787823722.527622:0:15517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787823722.527635:0:15517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f552a1d1/0x5d1142b832482a04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.527641:0:15517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d2000 already unused, calling callback (ffffffffc1649440) 00010000:00010000:2.0:1787823722.527645:0:15517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f552a1d1/0x5d1142b832482a04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.527653:0:15517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f552a1d1/0x5d1142b832482a04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.527665:0:15517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f552a1d1/0x5d1142b832482a04 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.527672:0:15517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f552a1d1/0x5d1142b832482a04 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.527706:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823722.527708:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823722.527710:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787823722.528198:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787823722.528205:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aee9706f/0x5d1142b832482a0b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.528215:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=463s v=(0 0) 00010000:00010000:2.0:1787823722.528219:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823722.528224:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aee9706f/0x5d1142b832482a0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.528247:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aee9706f/0x5d1142b832482a0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.528255:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aee9706f/0x5d1142b832482a0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.528263:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aee9706f/0x5d1142b832482a0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.528279:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787823722.528290:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787823722.528295:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aee9706f/0x5d1142b832482a0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.528303:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d2400 already unused, calling callback (ffffffffc1649440) 00010000:00010000:2.0:1787823722.528307:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aee9706f/0x5d1142b832482a0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.528314:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aee9706f/0x5d1142b832482a0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.528326:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aee9706f/0x5d1142b832482a0b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.528334:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aee9706f/0x5d1142b832482a0b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.528355:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823722.528358:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823722.528360:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787823722.538560:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787823722.538579:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000889cae85/0x5d1142b832482a12 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.538600:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=463s v=(0 0) 00010000:00010000:2.0:1787823722.538606:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823722.538614:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000889cae85/0x5d1142b832482a12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.538629:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000889cae85/0x5d1142b832482a12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.538641:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000889cae85/0x5d1142b832482a12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.538647:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000889cae85/0x5d1142b832482a12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.538666:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787823722.542980:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787823722.542996:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000889cae85/0x5d1142b832482a12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.543024:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3800 already unused, calling callback (ffffffffc1649440) 00010000:00010000:2.0:1787823722.543029:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000889cae85/0x5d1142b832482a12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.543040:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000889cae85/0x5d1142b832482a12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.543709:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000889cae85/0x5d1142b832482a12 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.543721:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000889cae85/0x5d1142b832482a12 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.543742:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823722.543744:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823722.543746:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787823722.548596:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787823722.548612:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c53dacce/0x5d1142b832482a19 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.548631:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=463s v=(0 0) 00010000:00010000:2.0:1787823722.548636:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823722.548642:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c53dacce/0x5d1142b832482a19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.548656:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c53dacce/0x5d1142b832482a19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.548690:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c53dacce/0x5d1142b832482a19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.548698:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c53dacce/0x5d1142b832482a19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.548725:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787823722.548751:0:15517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787823722.548786:0:15517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c53dacce/0x5d1142b832482a19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.548794:0:15517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3e00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:2.0:1787823722.548799:0:15517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c53dacce/0x5d1142b832482a19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.548807:0:15517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c53dacce/0x5d1142b832482a19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.548824:0:15517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c53dacce/0x5d1142b832482a19 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.548832:0:15517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c53dacce/0x5d1142b832482a19 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.548853:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823722.548861:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823722.548863:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787823722.554518:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787823722.554532:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000889cae85/0x5d1142b832482a20 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.554550:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=463s v=(0 0) 00010000:00010000:2.0:1787823722.554555:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823722.554562:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000889cae85/0x5d1142b832482a20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.554577:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000889cae85/0x5d1142b832482a20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.554586:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000889cae85/0x5d1142b832482a20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.554594:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000889cae85/0x5d1142b832482a20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.554612:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787823722.554626:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787823722.554631:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000889cae85/0x5d1142b832482a20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.554638:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3800 already unused, calling callback (ffffffffc1649440) 00010000:00010000:2.0:1787823722.554642:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000889cae85/0x5d1142b832482a20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.554663:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000889cae85/0x5d1142b832482a20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.557255:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000889cae85/0x5d1142b832482a20 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.557277:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000889cae85/0x5d1142b832482a20 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.557309:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823722.557312:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823722.557315:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787823722.558008:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787823722.558017:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aee9706f/0x5d1142b832482a27 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.558031:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=463s v=(0 0) 00010000:00010000:2.0:1787823722.558036:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823722.558042:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aee9706f/0x5d1142b832482a27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.558239:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aee9706f/0x5d1142b832482a27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.558251:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aee9706f/0x5d1142b832482a27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.558265:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aee9706f/0x5d1142b832482a27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.558288:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787823722.558302:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787823722.558307:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aee9706f/0x5d1142b832482a27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.558315:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d2400 already unused, calling callback (ffffffffc1649440) 00010000:00010000:2.0:1787823722.558320:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aee9706f/0x5d1142b832482a27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.558329:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aee9706f/0x5d1142b832482a27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.558344:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aee9706f/0x5d1142b832482a27 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.558352:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aee9706f/0x5d1142b832482a27 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.558368:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823722.558370:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823722.558371:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787823722.559254:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787823722.559270:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f552a1d1/0x5d1142b832482a2e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.559282:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=463s v=(0 0) 00010000:00010000:2.0:1787823722.559286:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823722.559293:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f552a1d1/0x5d1142b832482a2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.559303:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f552a1d1/0x5d1142b832482a2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.559312:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f552a1d1/0x5d1142b832482a2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.559320:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f552a1d1/0x5d1142b832482a2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.559335:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787823722.559346:0:15517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787823722.559351:0:15517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f552a1d1/0x5d1142b832482a2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.559358:0:15517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d2000 already unused, calling callback (ffffffffc1649440) 00010000:00010000:2.0:1787823722.559362:0:15517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f552a1d1/0x5d1142b832482a2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.559370:0:15517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f552a1d1/0x5d1142b832482a2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.559390:0:15517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f552a1d1/0x5d1142b832482a2e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.559398:0:15517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f552a1d1/0x5d1142b832482a2e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.559414:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823722.559416:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823722.559418:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787823722.560283:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787823722.560292:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832482a35 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.560303:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=463s v=(0 0) 00010000:00010000:2.0:1787823722.560307:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823722.560313:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832482a35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.560324:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832482a35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.560334:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832482a35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.560342:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832482a35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.560369:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787823722.560379:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787823722.560384:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832482a35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.560392:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d2c00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:2.0:1787823722.560396:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832482a35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.560404:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832482a35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.560417:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832482a35 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.560424:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832482a35 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.560438:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823722.560440:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823722.560441:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787823722.560863:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787823722.560869:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005afb6609/0x5d1142b832482a3c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.560878:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=463s v=(0 0) 00010000:00010000:2.0:1787823722.560888:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823722.564551:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005afb6609/0x5d1142b832482a3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.564586:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005afb6609/0x5d1142b832482a3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.564598:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005afb6609/0x5d1142b832482a3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.564606:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005afb6609/0x5d1142b832482a3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.564628:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787823722.564645:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787823722.564650:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005afb6609/0x5d1142b832482a3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.564657:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3600 already unused, calling callback (ffffffffc1649440) 00010000:00010000:2.0:1787823722.564662:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005afb6609/0x5d1142b832482a3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.564671:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005afb6609/0x5d1142b832482a3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.565560:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005afb6609/0x5d1142b832482a3c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.565591:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005afb6609/0x5d1142b832482a3c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.565616:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823722.565619:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823722.565621:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787823722.566451:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787823722.566460:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a2b66f8/0x5d1142b832482a43 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.566473:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=463s v=(0 0) 00010000:00010000:2.0:1787823722.566478:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823722.566485:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a2b66f8/0x5d1142b832482a43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.566496:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a2b66f8/0x5d1142b832482a43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.566505:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a2b66f8/0x5d1142b832482a43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.566513:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a2b66f8/0x5d1142b832482a43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.566544:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787823722.567517:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787823722.567536:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028c6d5f8/0x5d1142b832482a4a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.567550:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=463s v=(0 0) 00010000:00010000:2.0:1787823722.567555:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823722.567562:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028c6d5f8/0x5d1142b832482a4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.567572:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028c6d5f8/0x5d1142b832482a4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.567581:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028c6d5f8/0x5d1142b832482a4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.567587:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028c6d5f8/0x5d1142b832482a4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.567601:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787823722.567612:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787823722.567618:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a2b66f8/0x5d1142b832482a43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.567625:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3400 already unused, calling callback (ffffffffc1649440) 00010000:00010000:2.0:1787823722.567629:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a2b66f8/0x5d1142b832482a43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.567637:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a2b66f8/0x5d1142b832482a43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.567659:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a2b66f8/0x5d1142b832482a43 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.567668:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a2b66f8/0x5d1142b832482a43 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.567698:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787823722.567702:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028c6d5f8/0x5d1142b832482a4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.567708:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d2a00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:2.0:1787823722.567711:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028c6d5f8/0x5d1142b832482a4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.567718:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028c6d5f8/0x5d1142b832482a4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.567727:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028c6d5f8/0x5d1142b832482a4a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.567734:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028c6d5f8/0x5d1142b832482a4a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.567746:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823722.567748:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823722.567755:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787823722.568146:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787823722.569416:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:2.0:1787823722.571223:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787823722.571236:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c53dacce/0x5d1142b832482a51 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.571253:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=463s v=(0 0) 00010000:00010000:2.0:1787823722.571258:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823722.571264:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c53dacce/0x5d1142b832482a51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.571279:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c53dacce/0x5d1142b832482a51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.571290:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c53dacce/0x5d1142b832482a51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.571298:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c53dacce/0x5d1142b832482a51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.571328:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787823722.572265:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787823722.572274:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c53dacce/0x5d1142b832482a51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.572286:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3e00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:1.0:1787823722.572291:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c53dacce/0x5d1142b832482a51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.572300:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c53dacce/0x5d1142b832482a51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.572318:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c53dacce/0x5d1142b832482a51 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.572327:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c53dacce/0x5d1142b832482a51 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.572349:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823722.572351:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823722.572353:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787823722.572784:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787823722.572793:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032570d00/0x5d1142b832482a58 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.572804:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=463s v=(0 0) 00010000:00010000:2.0:1787823722.572808:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823722.572814:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032570d00/0x5d1142b832482a58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.572837:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032570d00/0x5d1142b832482a58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.572847:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032570d00/0x5d1142b832482a58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.572855:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032570d00/0x5d1142b832482a58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.572875:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787823722.573292:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787823722.573298:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032570d00/0x5d1142b832482a58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.573307:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3a00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:1.0:1787823722.573311:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032570d00/0x5d1142b832482a58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.573332:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032570d00/0x5d1142b832482a58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.573346:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032570d00/0x5d1142b832482a58 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.573355:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032570d00/0x5d1142b832482a58 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.573372:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823722.573374:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823722.573376:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787823722.573651:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787823722.573658:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2c23d9b/0x5d1142b832482a5f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.573668:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=463s v=(0 0) 00010000:00010000:2.0:1787823722.573671:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823722.573676:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2c23d9b/0x5d1142b832482a5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.573698:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2c23d9b/0x5d1142b832482a5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.573706:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2c23d9b/0x5d1142b832482a5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.573724:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2c23d9b/0x5d1142b832482a5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.573744:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787823722.574376:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787823722.574383:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b832482a66 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.574391:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=463s v=(0 0) 00010000:00010000:2.0:1787823722.574395:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823722.574400:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b832482a66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.574408:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b832482a66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.574415:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b832482a66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.574421:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b832482a66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.574438:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787823722.574449:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787823722.574455:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2c23d9b/0x5d1142b832482a5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.574469:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d2800 already unused, calling callback (ffffffffc1649440) 00010000:00010000:2.0:1787823722.574473:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2c23d9b/0x5d1142b832482a5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.574481:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2c23d9b/0x5d1142b832482a5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.574495:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2c23d9b/0x5d1142b832482a5f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.574503:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2c23d9b/0x5d1142b832482a5f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.574520:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787823722.574523:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b832482a66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.574530:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3c00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:2.0:1787823722.574532:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b832482a66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.574539:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b832482a66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.574548:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b832482a66 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.574562:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b832482a66 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.574573:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823722.574575:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823722.574576:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787823722.575017:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787823722.575024:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f929f8e/0x5d1142b832482a6d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.575032:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=463s v=(0 0) 00010000:00010000:2.0:1787823722.575036:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823722.575041:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f929f8e/0x5d1142b832482a6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.575050:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f929f8e/0x5d1142b832482a6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.575650:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823722.575696:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f929f8e/0x5d1142b832482a6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.575704:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f929f8e/0x5d1142b832482a6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.575772:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787823722.576379:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787823722.576391:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a988888e/0x5d1142b832482a74 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.576402:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=463s v=(0 0) 00010000:00010000:2.0:1787823722.576406:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823722.576411:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a988888e/0x5d1142b832482a74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.576422:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a988888e/0x5d1142b832482a74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.576430:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a988888e/0x5d1142b832482a74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.576437:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a988888e/0x5d1142b832482a74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.576781:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787823722.576789:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f929f8e/0x5d1142b832482a6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.576799:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7900030000 already unused, calling callback (ffffffffc1649440) 00010000:00010000:1.0:1787823722.576803:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f929f8e/0x5d1142b832482a6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.576813:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f929f8e/0x5d1142b832482a6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.576829:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f929f8e/0x5d1142b832482a6d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.576849:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f929f8e/0x5d1142b832482a6d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.576866:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787823722.576869:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a988888e/0x5d1142b832482a74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.576876:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7900031400 already unused, calling callback (ffffffffc1649440) 00010000:00010000:1.0:1787823722.576880:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a988888e/0x5d1142b832482a74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.576887:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a988888e/0x5d1142b832482a74 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.576911:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a988888e/0x5d1142b832482a74 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.576919:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823722.576921:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823722.576922:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823722.577336:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787823722.577344:0:15002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a988888e/0x5d1142b832482a74 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787823722.577993:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787823722.578002:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000643c2866/0x5d1142b832482a7b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.578016:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=463s v=(0 0) 00010000:00010000:2.0:1787823722.578020:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823722.578033:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000643c2866/0x5d1142b832482a7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.578045:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000643c2866/0x5d1142b832482a7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.578127:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000643c2866/0x5d1142b832482a7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.578136:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000643c2866/0x5d1142b832482a7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.578224:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787823722.578644:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787823722.578650:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052703b1e/0x5d1142b832482a82 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.578659:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=463s v=(0 0) 00010000:00010000:2.0:1787823722.578662:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823722.578667:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052703b1e/0x5d1142b832482a82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.578677:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052703b1e/0x5d1142b832482a82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.578698:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052703b1e/0x5d1142b832482a82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.578717:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052703b1e/0x5d1142b832482a82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.578740:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787823722.578781:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787823722.578787:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000643c2866/0x5d1142b832482a7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.578794:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7900030800 already unused, calling callback (ffffffffc1649440) 00010000:00010000:2.0:1787823722.578798:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000643c2866/0x5d1142b832482a7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.578807:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000643c2866/0x5d1142b832482a7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.578824:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000643c2866/0x5d1142b832482a7b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.578832:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000643c2866/0x5d1142b832482a7b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.578848:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787823722.578852:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052703b1e/0x5d1142b832482a82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.578868:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7900030e00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:2.0:1787823722.578871:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052703b1e/0x5d1142b832482a82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.578879:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052703b1e/0x5d1142b832482a82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.578889:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052703b1e/0x5d1142b832482a82 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.579010:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823722.579017:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823722.579049:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052703b1e/0x5d1142b832482a82 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.579239:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823722.579241:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823722.579242:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787823722.579703:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787823722.579709:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c42492de/0x5d1142b832482a89 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.579720:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=463s v=(0 0) 00010000:00010000:2.0:1787823722.579725:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823722.579731:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c42492de/0x5d1142b832482a89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.579740:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c42492de/0x5d1142b832482a89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.579754:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c42492de/0x5d1142b832482a89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.579841:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c42492de/0x5d1142b832482a89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.579860:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787823722.580793:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787823722.580802:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043680a3e/0x5d1142b832482a90 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.580814:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=463s v=(0 0) 00010000:00010000:2.0:1787823722.580820:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823722.580825:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043680a3e/0x5d1142b832482a90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.580836:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043680a3e/0x5d1142b832482a90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.580844:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043680a3e/0x5d1142b832482a90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.580851:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043680a3e/0x5d1142b832482a90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823722.580876:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:2.0:1787823722.581328:0:15002:0:(ofd_dev.c:1521:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:2.0:1787823722.581418:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14341:x1874668651908992:12345-0@lo:5:osp-pre-1-0.0 Request processed in 101593us (102171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823722.581428:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787823722.584220:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787823722.584238:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c42492de/0x5d1142b832482a89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.584269:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7900031a00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:1.0:1787823722.584274:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c42492de/0x5d1142b832482a89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.584285:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c42492de/0x5d1142b832482a89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.584310:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c42492de/0x5d1142b832482a89 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.584319:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c42492de/0x5d1142b832482a89 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.584346:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787823722.584350:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043680a3e/0x5d1142b832482a90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.584356:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7900031000 already unused, calling callback (ffffffffc1649440) 00010000:00010000:1.0:1787823722.584359:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043680a3e/0x5d1142b832482a90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.584367:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043680a3e/0x5d1142b832482a90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.584377:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043680a3e/0x5d1142b832482a90 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.584391:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043680a3e/0x5d1142b832482a90 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823722.584405:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823722.584406:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823722.584408:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823722.584458:0:14341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0e1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14341:1874668651908992:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787823722.584475:0:14341:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:1.0:1787823722.584522:0:14341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0e1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14341:1874668651909120:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787823722.584581:0:14341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823722.584675:0:14341:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7904944180 going to sleep for 11 seconds 00010000:00010000:1.0:1787823722.584705:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787823722.593250:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651909120 00000100:00100000:2.0:1787823722.593266:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651909120 00000100:00100000:2.0:1787823722.594169:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787823722.594184:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14341:x1874668651909120:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1787823722.594241:0:15001:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1787823722.603371:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14341:x1874668651909120:12345-0@lo:5:osp-pre-1-0.0 Request processed in 9181us (18778us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787823722.603388:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787823722.603645:0:14341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0e1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14341:1874668651909120:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787823722.603663:0:14341:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1787823722.986944:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787823722.986973:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a0ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651909248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787823722.987045:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823722.988435:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651909248 00000100:00100000:2.0:1787823722.988447:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651909248 00000100:00100000:2.0:1787823722.988512:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787823722.988522:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651909248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787823722.988560:0:15003:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787823722.988628:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651909248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (1582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823722.988636:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787823722.988849:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a0ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651909248:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787823723.380250:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823724.393912:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787823724.940579:0:16071:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg235-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787823725.417927:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823726.443750:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823727.094229:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823727.094339:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629893120 00000100:00100000:1.0:1787823727.094350:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629893120 00000100:00100000:1.0:1787823727.094421:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 74 00000100:00100000:1.0:1787823727.094430:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79182ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2351:x1874668629893120:12345-192.168.202.35@tcp:250:mount.lustre.0 00010000:00080000:1.0:1787823727.094460:0:14311:0:(ldlm_lib.c:1454:target_handle_connect()) MGS: connection from 0284c747-3fb5-4c50-9b22-d854f5cdb6b4@192.168.202.35@tcp t0 exp 0000000000000000 cur 467 last 0 00000020:00000080:1.0:1787823727.094492:0:14311:0:(genops.c:1385:class_connect()) connect: client 0284c747-3fb5-4c50-9b22-d854f5cdb6b4, cookie 0x5d1142b832482a97 00000100:00080000:1.0:1787823727.094685:0:14311:0:(import.c:65:import_set_state_nolock()) ffff8e7938a00800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787823727.094885:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79182ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+5:2351:x1874668629893120:12345-192.168.202.35@tcp:250:mount.lustre.0 Request processed in 453us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823727.094893:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 74 00000100:00100000:3.0:1787823727.105289:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823727.105402:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629893248 00000100:00100000:2.0:1787823727.105411:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629893248 00000100:00100000:2.0:1787823727.105471:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 75 00000100:00100000:2.0:1787823727.105481:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79182bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+5:13734:x1874668629893248:12345-192.168.202.35@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787823727.105516:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823727.105538:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7900030400/0x5d1142b832482a9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44a98 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823727.105567:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7900030400/0x5d1142b832482a9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a98 expref: 6 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823727.105752:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7900030400/0x5d1142b832482a9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a98 expref: 6 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823727.106388:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7900030400, rc 0) 00000100:00100000:2.0:1787823727.106460:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79182bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+6:13734:x1874668629893248:12345-192.168.202.35@tcp:101:mount.lustre.0 Request processed in 978us (1180us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823727.106468:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 75 00000100:00100000:0.0:1787823727.108820:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823727.108923:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629893376 00000100:00100000:1.0:1787823727.108932:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629893376 00000100:00100000:1.0:1787823727.108982:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 76 00000100:00100000:1.0:1787823727.108991:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79182bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+6:13734:x1874668629893376:12345-192.168.202.35@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787823727.109257:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79182bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+6:13734:x1874668629893376:12345-192.168.202.35@tcp:501:mount.lustre.0 Request processed in 265us (444us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787823727.109265:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 76 00000100:00100000:0.0:1787823727.112737:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823727.113000:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629893504 00000100:00100000:2.0:1787823727.113010:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629893504 00000100:00100000:2.0:1787823727.113114:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 77 00000100:00100000:2.0:1787823727.113125:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79182b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+6:13734:x1874668629893504:12345-192.168.202.35@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787823727.113142:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823727.113159:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7900031c00/0x5d1142b832482aa5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44a9f expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823727.113188:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7900031c00/0x5d1142b832482aa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a9f expref: 7 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823727.113204:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7900031c00/0x5d1142b832482aa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44a9f expref: 7 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823727.113233:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7900031c00, rc 0) 00000100:00100000:2.0:1787823727.113293:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79182b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+7:13734:x1874668629893504:12345-192.168.202.35@tcp:101:mount.lustre.0 Request processed in 169us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823727.113300:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 77 00000100:00100000:0.0:1787823727.114955:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823727.115036:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629893632 00000100:00100000:3.0:1787823727.115045:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629893632 00000100:00100000:3.0:1787823727.115137:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 78 00000100:00100000:3.0:1787823727.115145:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79182bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+7:13734:x1874668629893632:12345-192.168.202.35@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787823727.115417:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79182bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+8:13734:x1874668629893632:12345-192.168.202.35@tcp:501:mount.lustre.0 Request processed in 272us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823727.115425:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 78 00000100:00100000:0.0:1787823727.125145:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823727.126474:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629893760 00000100:00100000:2.0:1787823727.126487:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629893760 00000100:00100000:2.0:1787823727.126546:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 79 00000100:00100000:2.0:1787823727.126555:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79182bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+8:13734:x1874668629893760:12345-192.168.202.35@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787823727.127000:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79182bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+8:13734:x1874668629893760:12345-192.168.202.35@tcp:503:mount.lustre.0 Request processed in 443us (1865us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823727.127010:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 79 00000100:00100000:0.0:1787823727.131891:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823727.132008:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629893888 00000100:00100000:1.0:1787823727.132018:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629893888 00000100:00100000:1.0:1787823727.132072:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 80 00000100:00100000:1.0:1787823727.132082:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79182b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+8:13753:x1874668629893888:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787823727.132348:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79182b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+8:13753:x1874668629893888:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 266us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823727.132356:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 80 00000100:00100000:0.0:1787823727.151943:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823727.152059:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629894016 00000100:00100000:3.0:1787823727.152082:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629894016 00000100:00100000:3.0:1787823727.152142:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 81 00000100:00100000:3.0:1787823727.152153:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79182b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+8:13753:x1874668629894016:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787823727.152439:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79182b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+8:13753:x1874668629894016:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 287us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823727.152448:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 81 00000100:00100000:0.0:1787823727.162577:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823727.169296:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629894144 00000100:00100000:2.0:1787823727.169313:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629894144 00000100:00100000:2.0:1787823727.169493:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 82 00000100:00100000:2.0:1787823727.169503:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79182b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+8:13734:x1874668629894144:12345-192.168.202.35@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787823727.169521:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823727.169537:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7900030200/0x5d1142b832482aac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44ac9 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823727.169564:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7900030200/0x5d1142b832482aac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44ac9 expref: 9 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823727.169575:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7900030200/0x5d1142b832482aac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44ac9 expref: 9 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823727.169596:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7900030200, rc 0) 00000100:00100000:2.0:1787823727.169697:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79182b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+9:13734:x1874668629894144:12345-192.168.202.35@tcp:101:mount.lustre.0 Request processed in 195us (7133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823727.169705:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 82 00000100:00100000:0.0:1787823727.180463:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823727.180568:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629894272 00000100:00100000:1.0:1787823727.180652:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629894272 00000100:00100000:1.0:1787823727.180788:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 83 00000100:00100000:1.0:1787823727.180801:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79182b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+9:13734:x1874668629894272:12345-192.168.202.35@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787823727.180830:0:14311:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787823727.181091:0:14311:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787823727.181097:0:14311:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787823727.181100:0:14311:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787823727.181102:0:14311:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1787823727.186668:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79182b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+9:13734:x1874668629894272:12345-192.168.202.35@tcp:256:mount.lustre.0 Request processed in 5782us (6127us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823727.186685:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 83 00000100:00100000:0.0:1787823727.194437:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823727.194529:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629894400 00000100:00100000:2.0:1787823727.194539:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629894400 00000100:00100000:2.0:1787823727.194685:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 84 00000100:00100000:2.0:1787823727.194696:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a45c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+9:13734:x1874668629894400:12345-192.168.202.35@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787823727.194715:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823727.194734:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7900031800/0x5d1142b832482ab3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44ad0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823727.194800:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7900031800/0x5d1142b832482ab3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44ad0 expref: 10 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823727.194812:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7900031800/0x5d1142b832482ab3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44ad0 expref: 10 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823727.194821:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7900031800, rc 0) 00000100:00100000:2.0:1787823727.195086:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a45c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+10:13734:x1874668629894400:12345-192.168.202.35@tcp:101:mount.lustre.0 Request processed in 390us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823727.195095:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 84 00000100:00100000:0.0:1787823727.197348:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823727.197503:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629894528 00000100:00100000:1.0:1787823727.197513:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629894528 00000100:00100000:1.0:1787823727.197663:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 85 00000100:00100000:1.0:1787823727.197673:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a45ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+10:13734:x1874668629894528:12345-192.168.202.35@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787823727.198283:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a45ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+10:13734:x1874668629894528:12345-192.168.202.35@tcp:501:mount.lustre.0 Request processed in 608us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823727.198292:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 85 00000100:00100000:0.0:1787823727.200873:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823727.200975:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629894656 00000100:00100000:2.0:1787823727.200985:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629894656 00000100:00100000:2.0:1787823727.201069:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 86 00000100:00100000:2.0:1787823727.201079:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a45d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+10:13734:x1874668629894656:12345-192.168.202.35@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787823727.201309:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a45d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+10:13734:x1874668629894656:12345-192.168.202.35@tcp:503:mount.lustre.0 Request processed in 231us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823727.201327:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 86 00000100:00100000:0.0:1787823727.204130:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823727.204206:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629894784 00000100:00100000:1.0:1787823727.204215:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629894784 00000100:00100000:1.0:1787823727.204268:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 87 00000100:00100000:1.0:1787823727.204278:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a45c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+10:13755:x1874668629894784:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787823727.204516:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a45c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+10:13755:x1874668629894784:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 239us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823727.204524:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 87 00000100:00100000:0.0:1787823727.212849:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823727.212946:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629894912 00000100:00100000:1.0:1787823727.212957:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629894912 00000100:00100000:1.0:1787823727.213019:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 88 00000100:00100000:1.0:1787823727.213028:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a45e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+10:13755:x1874668629894912:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787823727.213288:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a45e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+10:13755:x1874668629894912:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 259us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823727.213296:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 88 00000100:00100000:3.0:1787823727.227115:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823727.227285:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629895040 00000100:00100000:2.0:1787823727.227296:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629895040 00000100:00100000:2.0:1787823727.227349:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 4 00000100:00100000:2.0:1787823727.227358:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2351:x1874668629895040:12345-192.168.202.35@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787823727.227388:0:14317:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from 5d7e3b57-4f07-412f-99dc-6b89e11a87ce@192.168.202.35@tcp t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:2.0:1787823727.227434:0:14317:0:(genops.c:1385:class_connect()) connect: client 5d7e3b57-4f07-412f-99dc-6b89e11a87ce, cookie 0x5d1142b832482aba 00000004:00100000:2.0:1787823727.227464:0:14317:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1787823727.227471:0:14317:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1787823727.293320:0:14317:0:(import.c:65:import_set_state_nolock()) ffff8e7939edc000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787823727.293957:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+6:2351:x1874668629895040:12345-192.168.202.35@tcp:38:mount.lustre.0 Request processed in 66595us (66848us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823727.293970:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 4 00000100:00100000:0.0:1787823727.303041:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823727.303087:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823727.303476:0:15477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629895168 00000100:00100000:2.0:1787823727.303487:0:15477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629895168 00000100:00080000:0.0:1787823727.303670:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787823727.303903:0:15477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629895296 00000100:00100000:2.0:1787823727.303907:0:15477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629895296 00000100:00100000:3.0:1787823727.305557:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 5 00000100:00100000:3.0:1787823727.305627:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7802e12940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+7:0:x1874668629895168:12345-192.168.202.35@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787823727.305679:0:14316:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787823727.306246:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7802e12940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+7:0:x1874668629895168:12345-192.168.202.35@tcp:41:mount.lustre.0 Request processed in 675us (3211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823727.306256:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 5 00000100:00100000:3.0:1787823727.306282:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 6 00000100:00100000:3.0:1787823727.306291:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7802e121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+6:13734:x1874668629895296:12345-192.168.202.35@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787823727.306306:0:14316:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787823727.306331:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7802e121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+6:13734:x1874668629895296:12345-192.168.202.35@tcp:41:mount.lustre.0 Request processed in 43us (3244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823727.306337:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 6 00000100:00100000:0.0:1787823727.313034:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823727.313461:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629895424 00000100:00100000:3.0:1787823727.313472:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629895424 00000100:00100000:3.0:1787823727.313549:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 7 00000100:00100000:3.0:1787823727.313560:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7802e103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+6:13734:x1874668629895424:12345-192.168.202.35@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787823727.313663:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7802e103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+6:13734:x1874668629895424:12345-192.168.202.35@tcp:40:mount.lustre.0 Request processed in 105us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823727.313671:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 7 00000100:00100000:0.0:1787823727.317301:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823727.317346:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823727.317505:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629895552 00000100:00100000:1.0:1787823727.317529:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629895552 00000100:00100000:0.0:1787823727.317657:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823727.317695:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629895808 00000100:00100000:0.0:1787823727.317699:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629895808 00000100:00100000:0.0:1787823727.317749:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 0 00000100:00100000:0.0:1787823727.317788:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7802e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+6:13734:x1874668629895808:12345-192.168.202.35@tcp:33:mount.lustre.0 00000004:00080000:0.0:1787823727.318369:0:14319:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 503us 00000100:00100000:2.0:1787823727.319840:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629895680 00000100:00100000:2.0:1787823727.319849:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629895680 00000100:00100000:2.0:1787823727.319885:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 8 00000100:00100000:2.0:1787823727.319893:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7802e112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1874668629895552:12345-192.168.202.35@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787823727.319920:0:15002:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from 5d7e3b57-4f07-412f-99dc-6b89e11a87ce@192.168.202.35@tcp t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:2.0:1787823727.319951:0:15002:0:(genops.c:1385:class_connect()) connect: client 5d7e3b57-4f07-412f-99dc-6b89e11a87ce, cookie 0x5d1142b832482ac1 00002000:00100000:2.0:1787823727.319964:0:15002:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5d7e3b57-4f07-412f-99dc-6b89e11a87ce/ffff8e79262b2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787823727.319989:0:15002:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787823727.320297:0:15002:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787823727.320333:0:15002:0:(import.c:65:import_set_state_nolock()) ffff8e79262b5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787823727.320484:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7802e112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+6:2351:x1874668629895552:12345-192.168.202.35@tcp:8:mount.lustre.0 Request processed in 533us (3136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823727.320501:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 8 00000100:00100000:2.0:1787823727.320523:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00100000:2.0:1787823727.320528:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7802e10780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1874668629895680:12345-192.168.202.35@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787823727.320543:0:15002:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from 5d7e3b57-4f07-412f-99dc-6b89e11a87ce@192.168.202.35@tcp t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:2.0:1787823727.320562:0:15002:0:(genops.c:1385:class_connect()) connect: client 5d7e3b57-4f07-412f-99dc-6b89e11a87ce, cookie 0x5d1142b832482ac8 00002000:00100000:2.0:1787823727.320567:0:15002:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5d7e3b57-4f07-412f-99dc-6b89e11a87ce/ffff8e79361cb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787823727.320582:0:15002:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787823727.320916:0:15002:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787823727.320936:0:15002:0:(import.c:65:import_set_state_nolock()) ffff8e7909391000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787823727.320966:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7802e10780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+6:2351:x1874668629895680:12345-192.168.202.35@tcp:8:mount.lustre.0 Request processed in 436us (3619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823727.320973:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 9 00000004:00200000:2.0:1787823727.330243:0:14319:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1787823727.330477:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7802e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+6:13734:x1874668629895808:12345-192.168.202.35@tcp:33:mount.lustre.0 Request processed in 12712us (12813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823727.330493:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 0 00010000:00010000:1.0:1787823727.465964:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787823727.502944:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823727.503122:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629895936 00000100:00100000:1.0:1787823727.503134:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629895936 00000100:00100000:1.0:1787823727.503245:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 8 00000100:00100000:1.0:1787823727.503256:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7802e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+6:13776:x1874668629895936:12345-192.168.202.35@tcp:101:mkdir.0 00010000:00010000:1.0:1787823727.503278:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823727.503302:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482acf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44afa expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823727.503375:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeb600/0x5d1142b832482ad6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823727.503389:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeb600/0x5d1142b832482ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823727.503405:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeb600/0x5d1142b832482ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787823727.503603:0:14318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787823727.503608:0:14318:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787823727.503717:0:14318:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeb600/0x5d1142b832482ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823727.503747:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482acf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44afa expref: 8 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823727.503802:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeb600/0x5d1142b832482ad6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44afa expref: 7 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823727.503810:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e7917859300) 00010000:00010000:1.0:1787823727.503820:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787823727.503824:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7920eeb600, rc 0) 00000100:00100000:1.0:1787823727.503900:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7802e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+7:13776:x1874668629895936:12345-192.168.202.35@tcp:101:mkdir.0 Request processed in 646us (1156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823727.503908:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 8 00000100:00100000:2.0:1787823727.595242:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787823727.595265:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a0ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651909376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787823727.595334:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823727.595422:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651909376 00000100:00100000:2.0:1787823727.595431:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651909376 00000100:00100000:2.0:1787823727.595484:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787823727.595492:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0ee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874668651909376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787823727.595515:0:15003:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787823727.595571:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0ee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874668651909376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823727.595579:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787823727.595623:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a0ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651909376:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787823727.595832:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787823727.596509:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874668651909760:0@lo:400:kworker.0 00000100:00100000:1.0:1787823727.596548:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823727.596571:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787823727.596576:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651909632:0@lo:400:kworker.0 00000100:00100000:1.0:1787823727.596598:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823727.596628:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b00b7bac-c389-4a58-8ac8-b4f04764fb77:3306:1874668651909504:0@lo:400:kworker.0 00000100:00100000:1.0:1787823727.596667:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823727.596686:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874668651910016:0@lo:400:kworker.0 00000100:00100000:1.0:1787823727.596712:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823727.596726:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787823727.596731:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7922a0ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874668651909888:0@lo:400:kworker.0 00000100:00100000:1.0:1787823727.596752:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823727.596818:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651909504 00000100:00100000:1.0:1787823727.596824:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651909504 00000100:00100000:1.0:1787823727.596872:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787823727.596879:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a45f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+19:3306:x1874668651909504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823727.596918:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a45f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+19:3306:x1874668651909504:12345-0@lo:400:kworker.0 Request processed in 39us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823727.596925:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787823727.596964:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b00b7bac-c389-4a58-8ac8-b4f04764fb77:3306:1874668651909504:0@lo:400:kworker.0 00000100:00100000:1.0:1787823727.596986:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651909632 00000100:00100000:1.0:1787823727.596998:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651909632 00000100:00100000:1.0:1787823727.597453:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787823727.597461:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651909632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823727.597500:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651909632:12345-0@lo:400:kworker.0 Request processed in 40us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823727.597506:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787823727.597538:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651909632:0@lo:400:kworker.0 00000100:00100000:1.0:1787823727.597569:0:15477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651909760 00000100:00100000:1.0:1787823727.597572:0:15477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651909760 00000100:00100000:1.0:1787823727.597594:0:15477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651910016 00000100:00100000:1.0:1787823727.597597:0:15477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651910016 00000100:00100000:1.0:1787823727.597609:0:15477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651909888 00000100:00100000:1.0:1787823727.597611:0:15477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651909888 00000100:00100000:1.0:1787823727.597626:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787823727.597631:0:15477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874668651909760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823727.597677:0:15477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874668651909760:12345-0@lo:400:kworker.0 Request processed in 46us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823727.597683:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787823727.597694:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787823727.597700:0:15477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874668651910016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823727.597729:0:15477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874668651910016:12345-0@lo:400:kworker.0 Request processed in 29us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823727.597735:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787823727.597746:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787823727.597752:0:15477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874668651909888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823727.597807:0:15477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874668651909888:12345-0@lo:400:kworker.0 Request processed in 55us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823727.597823:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787823727.599229:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874668651909888:0@lo:400:kworker.0 00000100:00100000:2.0:1787823727.599246:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874668651910016:0@lo:400:kworker.0 00000100:00080000:0.0:1787823727.599347:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787823727.599353:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787823727.601466:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7922a0cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874668651909760:0@lo:400:kworker.0 00000001:00100000:0.0:1787823727.728353:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5d7e3b57-4f07-412f-99dc-6b89e11a87ce 00000001:00080000:0.0:1787823727.728382:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1787823727.728421:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787823728.106151:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a0ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651910144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787823728.106232:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823728.106376:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651910144 00000100:00100000:2.0:1787823728.106384:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651910144 00000100:00100000:2.0:1787823728.106435:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787823728.106444:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651910144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787823728.106467:0:15003:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787823728.106520:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651910144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823728.106527:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787823728.106754:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a0ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651910144:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787823728.491490:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823729.411548:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823729.411817:0:15477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629896064 00000100:00100000:1.0:1787823729.411827:0:15477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629896064 00000100:00100000:1.0:1787823729.411917:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00100000:1.0:1787823729.411928:0:15477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+7:13829:x1874668629896064:12345-192.168.202.35@tcp:41:lfs.0 00000004:00000024:1.0:1787823729.411972:0:15477:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:0.0:1787823729.412126:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787823729.412939:0:15477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+7:13829:x1874668629896064:12345-192.168.202.35@tcp:41:lfs.0 Request processed in 1009us (1397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823729.412950:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00100000:0.0:1787823729.418383:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823729.418551:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629896192 00000100:00100000:2.0:1787823729.418564:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629896192 00000100:00100000:2.0:1787823729.418657:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 6 00000100:00100000:2.0:1787823729.418669:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7802e10f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+6:13829:x1874668629896192:12345-192.168.202.35@tcp:13:lfs.0 00002000:00000024:2.0:1787823729.418715:0:15003:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787823729.418848:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7802e10f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+6:13829:x1874668629896192:12345-192.168.202.35@tcp:13:lfs.0 Request processed in 182us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823729.418857:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 6 00000100:00080000:0.0:1787823729.419515:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787823729.421218:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823729.422672:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629896320 00000100:00100000:2.0:1787823729.422685:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629896320 00000100:00100000:2.0:1787823729.422797:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 7 00000100:00100000:2.0:1787823729.422810:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7802e13c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+5:13829:x1874668629896320:12345-192.168.202.35@tcp:13:lfs.0 00002000:00000024:2.0:1787823729.422861:0:15003:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787823729.422955:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7802e13c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+5:13829:x1874668629896320:12345-192.168.202.35@tcp:13:lfs.0 Request processed in 148us (1747us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823729.422963:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 7 00000100:00080000:0.0:1787823729.423187:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787823729.513990:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823729.623708:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823729.626485:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629896448 00000100:00100000:3.0:1787823729.626502:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629896448 00000100:00100000:3.0:1787823729.626581:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 90 00000100:00100000:3.0:1787823729.626591:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a45f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+10:13861:x1874668629896448:12345-192.168.202.35@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787823729.626608:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823729.626637:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e793a26d800/0x5d1142b832482add lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44b01 expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823729.626667:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e793a26d800/0x5d1142b832482add lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b01 expref: 11 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823729.626678:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e793a26d800/0x5d1142b832482add lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b01 expref: 11 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823729.626687:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a26d800, rc 0) 00000100:00100000:3.0:1787823729.626909:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a45f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+11:13861:x1874668629896448:12345-192.168.202.35@tcp:101:mount.lustre.0 Request processed in 319us (3213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823729.626917:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 90 00000100:00100000:1.0:1787823729.631354:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823729.631513:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629896576 00000100:00100000:2.0:1787823729.631524:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629896576 00000100:00100000:2.0:1787823729.631587:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 91 00000100:00100000:2.0:1787823729.631597:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a45f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+11:13861:x1874668629896576:12345-192.168.202.35@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787823729.632289:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a45f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+11:13861:x1874668629896576:12345-192.168.202.35@tcp:501:mount.lustre.0 Request processed in 690us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823729.632299:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 91 00000100:00100000:0.0:1787823729.634254:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823729.634408:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629896704 00000100:00100000:1.0:1787823729.634420:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629896704 00000100:00100000:1.0:1787823729.634511:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 92 00000100:00100000:1.0:1787823729.634521:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a45fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+11:13861:x1874668629896704:12345-192.168.202.35@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787823729.635011:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a45fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+11:13861:x1874668629896704:12345-192.168.202.35@tcp:503:mount.lustre.0 Request processed in 489us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823729.635020:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 92 00000100:00100000:1.0:1787823729.638262:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823729.638368:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629896832 00000100:00100000:2.0:1787823729.638379:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629896832 00000100:00100000:2.0:1787823729.638439:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 93 00000100:00100000:2.0:1787823729.638451:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a45e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+11:13868:x1874668629896832:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787823729.638876:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a45e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+11:13868:x1874668629896832:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 426us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823729.638884:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 93 00000100:00100000:0.0:1787823729.668371:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823729.668517:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629896960 00000100:00100000:1.0:1787823729.668526:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629896960 00000100:00100000:1.0:1787823729.668574:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 94 00000100:00100000:1.0:1787823729.668594:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a45d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+11:13868:x1874668629896960:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787823729.668911:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a45d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+11:13868:x1874668629896960:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 327us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823729.668918:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 94 00000100:00100000:0.0:1787823729.673498:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823729.674434:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629897088 00000100:00100000:3.0:1787823729.674465:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629897088 00000100:00100000:3.0:1787823729.674560:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 95 00000100:00100000:3.0:1787823729.674571:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a45cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+11:13861:x1874668629897088:12345-192.168.202.35@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787823729.674661:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823729.674682:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e793a26c400/0x5d1142b832482ae4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44b2b expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823729.674735:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e793a26c400/0x5d1142b832482ae4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b2b expref: 12 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823729.674747:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e793a26c400/0x5d1142b832482ae4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b2b expref: 12 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823729.674789:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a26c400, rc 0) 00000100:00100000:3.0:1787823729.675011:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a45cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+12:13861:x1874668629897088:12345-192.168.202.35@tcp:101:mount.lustre.0 Request processed in 284us (1368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823729.675019:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 95 00000100:00100000:3.0:1787823729.677267:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823729.677353:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629897216 00000100:00100000:2.0:1787823729.677363:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629897216 00000100:00100000:2.0:1787823729.677419:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 96 00000100:00100000:2.0:1787823729.677429:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a45c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+12:13861:x1874668629897216:12345-192.168.202.35@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787823729.677453:0:14311:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787823729.677478:0:14311:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787823729.677486:0:14311:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787823729.677489:0:14311:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787823729.677491:0:14311:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1787823729.679953:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a45c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+12:13861:x1874668629897216:12345-192.168.202.35@tcp:256:mount.lustre.0 Request processed in 2419us (2588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823729.679967:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 96 00000100:00100000:0.0:1787823729.682874:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823729.683143:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629897344 00000100:00100000:3.0:1787823729.683154:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629897344 00000100:00100000:3.0:1787823729.683206:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 97 00000100:00100000:3.0:1787823729.683216:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793510c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+12:13861:x1874668629897344:12345-192.168.202.35@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787823729.683234:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823729.683251:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e793a26c800/0x5d1142b832482aeb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44b32 expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823729.683279:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e793a26c800/0x5d1142b832482aeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b32 expref: 13 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823729.683309:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e793a26c800/0x5d1142b832482aeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b32 expref: 13 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823729.683319:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a26c800, rc 0) 00000100:00100000:3.0:1787823729.683390:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793510c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+13:13861:x1874668629897344:12345-192.168.202.35@tcp:101:mount.lustre.0 Request processed in 176us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823729.683398:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 97 00000100:00100000:3.0:1787823729.686411:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823729.686654:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629897472 00000100:00100000:2.0:1787823729.686664:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629897472 00000100:00100000:2.0:1787823729.686959:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 98 00000100:00100000:2.0:1787823729.686970:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793510ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+13:13861:x1874668629897472:12345-192.168.202.35@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787823729.687431:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793510ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+13:13861:x1874668629897472:12345-192.168.202.35@tcp:501:mount.lustre.0 Request processed in 460us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823729.687439:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 98 00000100:00100000:0.0:1787823729.690739:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823729.691187:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629897600 00000100:00100000:1.0:1787823729.691196:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629897600 00000100:00100000:1.0:1787823729.691256:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 99 00000100:00100000:1.0:1787823729.691266:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793510cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+13:13861:x1874668629897600:12345-192.168.202.35@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787823729.691633:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793510cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+13:13861:x1874668629897600:12345-192.168.202.35@tcp:503:mount.lustre.0 Request processed in 366us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823729.691642:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 99 00000100:00100000:0.0:1787823729.695613:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823729.695794:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629897728 00000100:00100000:2.0:1787823729.695804:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629897728 00000100:00100000:2.0:1787823729.695875:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 100 00000100:00100000:2.0:1787823729.695887:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793510f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+13:13871:x1874668629897728:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787823729.696188:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793510f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+13:13871:x1874668629897728:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 302us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823729.696197:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 100 00000100:00100000:2.0:1787823729.702298:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823729.702571:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629897856 00000100:00100000:0.0:1787823729.702590:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629897856 00000100:00100000:0.0:1787823729.702651:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 101 00000100:00100000:0.0:1787823729.702662:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793510f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+13:13871:x1874668629897856:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787823729.702944:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793510f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+13:13871:x1874668629897856:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 283us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823729.702952:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 101 00000100:00100000:2.0:1787823729.718743:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823729.719171:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629897984 00000100:00100000:3.0:1787823729.719184:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629897984 00000100:00100000:3.0:1787823729.719242:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 10 00000100:00100000:3.0:1787823729.719251:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2351:x1874668629897984:12345-192.168.202.35@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787823729.719282:0:14316:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from fe458d9d-d7c9-49e7-b833-d87e1bb29306@192.168.202.35@tcp t0 exp 0000000000000000 cur 470 last 0 00000020:00000080:3.0:1787823729.719320:0:14316:0:(genops.c:1385:class_connect()) connect: client fe458d9d-d7c9-49e7-b833-d87e1bb29306, cookie 0x5d1142b832482af2 00000004:00100000:3.0:1787823729.719360:0:14316:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787823729.719493:0:14316:0:(import.c:65:import_set_state_nolock()) ffff8e7939ede800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787823729.719578:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe458d9d-d7c9-49e7-b833-d87e1bb29306+6:2351:x1874668629897984:12345-192.168.202.35@tcp:38:mount.lustre.0 Request processed in 326us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823729.719593:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 10 00000100:00100000:1.0:1787823729.727942:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823729.727982:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823729.728207:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629898240 00000100:00100000:3.0:1787823729.728217:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629898240 00000100:00100000:3.0:1787823729.728295:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629898112 00000100:00100000:3.0:1787823729.728299:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629898112 00000100:00100000:3.0:1787823729.728325:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 11 00000100:00100000:3.0:1787823729.728335:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe458d9d-d7c9-49e7-b833-d87e1bb29306+7:13861:x1874668629898240:12345-192.168.202.35@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787823729.728398:0:14317:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787823729.728472:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe458d9d-d7c9-49e7-b833-d87e1bb29306+7:13861:x1874668629898240:12345-192.168.202.35@tcp:41:mount.lustre.0 Request processed in 139us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823729.728480:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 11 00000100:00100000:3.0:1787823729.728498:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 12 00000100:00100000:3.0:1787823729.728504:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe458d9d-d7c9-49e7-b833-d87e1bb29306+6:0:x1874668629898112:12345-192.168.202.35@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787823729.728515:0:14317:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787823729.728537:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe458d9d-d7c9-49e7-b833-d87e1bb29306+6:0:x1874668629898112:12345-192.168.202.35@tcp:41:mount.lustre.0 Request processed in 33us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823729.728544:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 12 00000100:00080000:0.0:1787823729.728796:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787823729.734382:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823729.734856:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629898368 00000100:00100000:3.0:1787823729.734866:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629898368 00000100:00100000:3.0:1787823729.734930:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 13 00000100:00100000:3.0:1787823729.734940:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe458d9d-d7c9-49e7-b833-d87e1bb29306+6:13861:x1874668629898368:12345-192.168.202.35@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787823729.735131:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe458d9d-d7c9-49e7-b833-d87e1bb29306+6:13861:x1874668629898368:12345-192.168.202.35@tcp:40:mount.lustre.0 Request processed in 192us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823729.735138:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 13 00000100:00100000:3.0:1787823729.740500:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823729.740546:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823729.740652:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629898496 00000100:00100000:1.0:1787823729.740662:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629898496 00000100:00100000:1.0:1787823729.740712:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 10 00000100:00100000:1.0:1787823729.740720:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1874668629898496:12345-192.168.202.35@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787823729.740756:0:15000:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from fe458d9d-d7c9-49e7-b833-d87e1bb29306@192.168.202.35@tcp t0 exp 0000000000000000 cur 470 last 0 00000020:00000080:1.0:1787823729.740831:0:15000:0:(genops.c:1385:class_connect()) connect: client fe458d9d-d7c9-49e7-b833-d87e1bb29306, cookie 0x5d1142b832482af9 00002000:00100000:1.0:1787823729.740843:0:15000:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fe458d9d-d7c9-49e7-b833-d87e1bb29306/ffff8e7938a04000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787823729.740853:0:15000:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787823729.740968:0:15000:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787823729.741000:0:15000:0:(import.c:65:import_set_state_nolock()) ffff8e7938a05800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787823729.741076:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fe458d9d-d7c9-49e7-b833-d87e1bb29306+6:2351:x1874668629898496:12345-192.168.202.35@tcp:8:mount.lustre.0 Request processed in 355us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823729.741102:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 10 00000100:00100000:3.0:1787823729.741537:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823729.741606:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629898624 00000100:00100000:2.0:1787823729.741611:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629898624 00000100:00100000:2.0:1787823729.741651:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 11 00000100:00100000:2.0:1787823729.741656:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1874668629898624:12345-192.168.202.35@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787823729.741682:0:15001:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from fe458d9d-d7c9-49e7-b833-d87e1bb29306@192.168.202.35@tcp t0 exp 0000000000000000 cur 470 last 0 00000020:00000080:2.0:1787823729.741705:0:15001:0:(genops.c:1385:class_connect()) connect: client fe458d9d-d7c9-49e7-b833-d87e1bb29306, cookie 0x5d1142b832482b00 00002000:00100000:2.0:1787823729.741710:0:15001:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fe458d9d-d7c9-49e7-b833-d87e1bb29306/ffff8e7801808800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787823729.741716:0:15001:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787823729.741963:0:15001:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787823729.741986:0:15001:0:(import.c:65:import_set_state_nolock()) ffff8e7801809800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787823729.742039:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fe458d9d-d7c9-49e7-b833-d87e1bb29306+6:2351:x1874668629898624:12345-192.168.202.35@tcp:8:mount.lustre.0 Request processed in 380us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823729.742046:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 11 00000100:00100000:0.0:1787823729.744901:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629898752 00000100:00100000:0.0:1787823729.744918:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629898752 00000100:00100000:0.0:1787823729.744987:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 1 00000100:00100000:0.0:1787823729.744998:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fe458d9d-d7c9-49e7-b833-d87e1bb29306+6:13861:x1874668629898752:12345-192.168.202.35@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787823729.745457:0:14320:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787823729.747318:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fe458d9d-d7c9-49e7-b833-d87e1bb29306+6:13861:x1874668629898752:12345-192.168.202.35@tcp:33:mount.lustre.0 Request processed in 2312us (6760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823729.747332:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 1 00000100:00100000:3.0:1787823729.896270:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823729.896400:0:15477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629898880 00000100:00100000:2.0:1787823729.896413:0:15477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629898880 00000100:00100000:2.0:1787823729.896540:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 14 00000100:00100000:2.0:1787823729.896552:0:15477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe458d9d-d7c9-49e7-b833-d87e1bb29306+6:13892:x1874668629898880:12345-192.168.202.35@tcp:101:mkdir.0 00010000:00010000:2.0:1787823729.896574:0:15477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823729.896610:0:15477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030e00/0x5d1142b832482b07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44b5c expref: -99 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823729.896826:0:15477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031000/0x5d1142b832482b0e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823729.896858:0:15477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031000/0x5d1142b832482b0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823729.896881:0:15477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031000/0x5d1142b832482b0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787823729.897359:0:15477:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787823729.897371:0:15477:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787823729.897459:0:15477:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031000/0x5d1142b832482b0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823729.897491:0:15477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030e00/0x5d1142b832482b07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b5c expref: 8 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823729.897510:0:15477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031000/0x5d1142b832482b0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b5c expref: 7 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823729.897519:0:15477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e7917859300) 00010000:00010000:2.0:1787823729.897522:0:15477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787823729.897526:0:15477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7900031000, rc 0) 00000100:00100000:2.0:1787823729.898104:0:15477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe458d9d-d7c9-49e7-b833-d87e1bb29306+7:13892:x1874668629898880:12345-192.168.202.35@tcp:101:mkdir.0 Request processed in 1549us (1842us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823729.898113:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 14 00000040:00080000:0.0:1787823729.909081:0:14348:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787823730.538084:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823731.562017:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787823732.297379:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fe458d9d-d7c9-49e7-b833-d87e1bb29306 00000001:00100000:3.0:1787823732.297401:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5d7e3b57-4f07-412f-99dc-6b89e11a87ce 00010000:00010000:2.0:1787823732.587454:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823732.717271:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a76fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b00b7bac-c389-4a58-8ac8-b4f04764fb77:3308:1874668651910272:0@lo:400:kworker.0 00000100:00100000:1.0:1787823732.717747:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823732.717841:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a76c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874668651910784:0@lo:400:kworker.0 00000100:00100000:3.0:1787823732.717847:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a76e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651910400:0@lo:400:kworker.0 00000100:00100000:1.0:1787823732.717874:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823732.717905:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823732.717910:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787823732.717916:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a76ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874668651910656:0@lo:400:kworker.0 00000100:00100000:3.0:1787823732.717926:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a76cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874668651910912:0@lo:400:kworker.0 00000100:00100000:1.0:1787823732.717938:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823732.717955:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823732.717973:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a76e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651910528:0@lo:400:kworker.0 00000100:00100000:3.0:1787823732.717990:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651910784 00000100:00100000:3.0:1787823732.718000:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651910784 00000100:00100000:1.0:1787823732.718000:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823732.718056:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651910272 00000100:00100000:1.0:1787823732.718060:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651910272 00000100:00100000:3.0:1787823732.718064:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651910656 00000100:00100000:3.0:1787823732.718067:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651910656 00000100:00100000:3.0:1787823732.718079:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651910912 00000100:00100000:3.0:1787823732.718081:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651910912 00000100:00100000:1.0:1787823732.718096:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787823732.718097:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787823732.718107:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874668651910784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823732.718107:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793510d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+19:3308:x1874668651910272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823732.718163:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793510d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+19:3308:x1874668651910272:12345-0@lo:400:kworker.0 Request processed in 57us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823732.718165:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874668651910784:12345-0@lo:400:kworker.0 Request processed in 61us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823732.718171:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787823732.718171:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787823732.718190:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787823732.718196:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874668651910656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823732.718221:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874668651910656:12345-0@lo:400:kworker.0 Request processed in 26us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823732.718225:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787823732.718228:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787823732.718231:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874668651910912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823732.718245:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651910400 00000100:00100000:3.0:1787823732.718249:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651910400 00000100:00100000:1.0:1787823732.718261:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874668651910912:12345-0@lo:400:kworker.0 Request processed in 31us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823732.718267:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787823732.718291:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651910528 00000100:00100000:1.0:1787823732.718293:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787823732.718295:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651910528 00000100:00100000:3.0:1787823732.719071:0:15002:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787823732.719082:0:15002:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:3.0:1787823732.719117:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787823732.719124:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787823732.719128:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787823732.719178:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a76cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874668651910912:0@lo:400:kworker.0 00000100:00100000:3.0:1787823732.719204:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787823732.719214:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a0ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651911040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787823732.719660:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823732.719707:0:15000:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787823732.719718:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787823732.719729:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651910528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787823732.719783:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651910400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823732.719792:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651910528:12345-0@lo:400:kworker.0 Request processed in 68us (1792us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823732.719799:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787823732.719825:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651910400:12345-0@lo:400:kworker.0 Request processed in 1502us (1920us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823732.719831:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651911040 00000100:00100000:1.0:1787823732.719833:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787823732.719836:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651911040 00000100:00100000:3.0:1787823732.719866:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787823732.719873:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651911040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787823732.719905:0:15003:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787823732.719940:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874668651911040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823732.719947:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787823732.719974:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787823732.719995:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a0ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651911040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787823732.720009:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a76e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874668651910400:0@lo:400:kworker.0 00000100:00100000:1.0:1787823732.734516:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a76e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651910528:0@lo:400:kworker.0 00000100:00100000:1.0:1787823732.734702:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a76ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874668651910656:0@lo:400:kworker.0 00000100:00100000:1.0:1787823732.734716:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a76fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b00b7bac-c389-4a58-8ac8-b4f04764fb77:3308:1874668651910272:0@lo:400:kworker.0 00000100:00100000:1.0:1787823732.734731:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a76c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874668651910784:0@lo:400:kworker.0 00000001:00100000:0.0:1787823732.797964:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fe458d9d-d7c9-49e7-b833-d87e1bb29306 00000001:00100000:2.0:1787823732.800653:0:5860:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fe458d9d-d7c9-49e7-b833-d87e1bb29306 00000001:00100000:2.0:1787823732.800677:0:5860:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5d7e3b57-4f07-412f-99dc-6b89e11a87ce 00000001:02000400:1.0:1787823732.900130:0:16277:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1787823733.226266:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a0ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651911168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787823733.226383:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823733.226560:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651911168 00000100:00100000:2.0:1787823733.226571:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651911168 00000100:00100000:2.0:1787823733.226674:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787823733.226686:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651911168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787823733.226737:0:15003:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787823733.226827:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651911168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823733.226835:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787823733.227052:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a0ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651911168:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787823733.610015:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823734.635259:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823734.988725:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823734.991689:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823734.991740:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823734.992524:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823734.992561:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823734.992612:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823734.992641:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823734.992684:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629899264 00000100:00100000:3.0:1787823734.992698:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629899264 00000100:00100000:3.0:1787823734.992816:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629899776 00000100:00100000:3.0:1787823734.992820:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629899776 00000100:00100000:3.0:1787823734.992841:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629899392 00000100:00100000:3.0:1787823734.992844:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629899392 00000100:00100000:3.0:1787823734.992859:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629899648 00000100:00100000:3.0:1787823734.992862:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629899648 00000100:00100000:3.0:1787823734.992885:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 5 00000100:00100000:3.0:1787823734.992898:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+5:2352:x1874668629899264:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787823734.992995:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+5:2352:x1874668629899264:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 99us (1317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823734.993004:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 5 00000100:00100000:3.0:1787823734.993024:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 6 00000100:00100000:3.0:1787823734.993031:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fe458d9d-d7c9-49e7-b833-d87e1bb29306+5:2352:x1874668629899776:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787823734.993058:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fe458d9d-d7c9-49e7-b833-d87e1bb29306+5:2352:x1874668629899776:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 27us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823734.993065:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 6 00000100:00100000:3.0:1787823734.993077:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 7 00000100:00100000:3.0:1787823734.993084:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+5:2353:x1874668629899392:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787823734.993105:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+5:2353:x1874668629899392:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 23us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823734.993111:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 7 00000100:00100000:3.0:1787823734.995911:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 8 00000100:00100000:3.0:1787823734.995969:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fe458d9d-d7c9-49e7-b833-d87e1bb29306+5:2353:x1874668629899648:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787823734.996073:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fe458d9d-d7c9-49e7-b833-d87e1bb29306+5:2353:x1874668629899648:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 125us (3430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823734.996083:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 8 00000100:00100000:3.0:1787823734.996150:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629899136 00000100:00100000:3.0:1787823734.996161:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629899136 00000100:00100000:3.0:1787823734.996223:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629899520 00000100:00100000:3.0:1787823734.996227:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629899520 00000100:00100000:3.0:1787823734.996255:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 19 00000100:00100000:3.0:1787823734.997036:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+6:2353:x1874668629899136:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787823734.997105:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+6:2353:x1874668629899136:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 80us (5363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823734.997112:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 19 00000100:00100000:3.0:1787823734.997140:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 20 00000100:00100000:3.0:1787823734.997148:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe458d9d-d7c9-49e7-b833-d87e1bb29306+6:2352:x1874668629899520:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787823734.997177:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe458d9d-d7c9-49e7-b833-d87e1bb29306+6:2352:x1874668629899520:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 30us (4657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823734.997184:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 20 00000100:00080000:3.0:1787823734.997243:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787823734.997252:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787823734.997256:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787823734.997365:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629899008 00000100:00100000:2.0:1787823734.997444:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629899008 00000100:00100000:2.0:1787823734.997503:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 103 00000100:00100000:2.0:1787823734.997512:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793510c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+13:2352:x1874668629899008:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787823734.997545:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793510c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+13:2352:x1874668629899008:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 36us (8836us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823734.997553:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 103 00010000:00010000:2.0:1787823735.658026:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823736.682069:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787823737.273586:0:16425:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff99e12dd0 20000000:00000080:2.0:1787823737.273604:0:16425:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e79280cdc00 uarg=0000000000000000 20000000:01000000:2.0:1787823737.273642:0:16425:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787823737.273647:0:16425:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787823737.273652:0:16425:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787823737.276054:0:16426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1787823737.276358:0:16425:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787823737.288049:0:16425:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787823737.288320:0:16425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e7900030e00/0x5d1142b832482b15 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823737.288340:0:16425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e793a40ee00/0x5d1142b83248280c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832482805 expref: 18 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823737.288348:0:16425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e793a40f400/0x5d1142b832482859 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832482852 expref: 18 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823737.288354:0:16425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e793a26c000/0x5d1142b832482994 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b83248298d expref: 18 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823737.288363:0:16425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7900031800/0x5d1142b832482ab3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44ad0 expref: 12 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823737.288370:0:16425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e793a26c800/0x5d1142b832482aeb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b32 expref: 12 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823737.288393:0:16425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e7900030e00/0x5d1142b832482b15 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823737.288434:0:16425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e793a26c800/0x5d1142b832482aeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b32 expref: 12 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823737.288449:0:16425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e793a26c800/0x5d1142b832482aeb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b32 expref: 12 pid: 14309 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823737.288463:0:16425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a0eda40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1874668651911296:192.168.202.35@tcp:104: 00010000:00010000:2.0:1787823737.288649:0:16425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7900031800/0x5d1142b832482ab3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44ad0 expref: 12 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823737.288659:0:16425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e7900031800/0x5d1142b832482ab3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44ad0 expref: 12 pid: 14310 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823737.288668:0:16425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a0ec000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1874668651911424:192.168.202.35@tcp:104: 00010000:00010000:2.0:1787823737.288712:0:16425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e793a26c000/0x5d1142b832482994 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d1142b83248298d expref: 18 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823737.288721:0:16425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e793a26c000/0x5d1142b832482994 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d1142b83248298d expref: 18 pid: 14309 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823737.288730:0:16425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a0ee580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1874668651911552:0@lo:104: 00000100:00100000:2.0:1787823737.289902:0:16425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787823737.290129:0:16425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e793a40f400/0x5d1142b832482859 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d1142b832482852 expref: 18 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823737.290163:0:16425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e793a40f400/0x5d1142b832482859 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d1142b832482852 expref: 18 pid: 14309 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823737.290174:0:16425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a0eed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1874668651911680:0@lo:104: 00000100:00100000:2.0:1787823737.290201:0:16425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787823737.290708:0:16425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e793a40ee00/0x5d1142b83248280c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d1142b832482805 expref: 18 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823737.290718:0:16425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e793a40ee00/0x5d1142b83248280c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d1142b832482805 expref: 18 pid: 14310 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823737.290727:0:16425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a0ed680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1874668651911808:0@lo:104: 00000100:00100000:2.0:1787823737.290785:0:16425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823737.290815:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651911552 00000100:00100000:3.0:1787823737.290823:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651911552 00000100:00100000:0.0:1787823737.291028:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651911680 00000100:00100000:0.0:1787823737.291033:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651911680 00000100:00100000:0.0:1787823737.291059:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787823737.291068:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+4:16425:x1874668651911552:12345-0@lo:104: 00010000:00010000:0.0:1787823737.291081:0:14300:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff8e7920eeac00/0x5d1142b83248298d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b832482994 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823737.291179:0:14300:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787823737.291193:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+4:16425:x1874668651911552:12345-0@lo:104: Request processed in 126us (1293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823737.291201:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787823737.291334:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787823737.291341:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0ede00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+3:16425:x1874668651911680:12345-0@lo:104: 00010000:00010000:0.0:1787823737.291349:0:14300:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff8e793a26de00/0x5d1142b832482852 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b832482859 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823737.291410:0:15517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787823737.291417:0:15517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e7920eeac00/0x5d1142b83248298d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b832482994 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823737.291424:0:15517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eeac00 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:1.0:1787823737.291429:0:15517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e7920eeac00/0x5d1142b83248298d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d1142b832482994 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823737.291436:0:15517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e7920eeac00/0x5d1142b83248298d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d1142b832482994 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787823737.291443:0:15517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e7920eeac00/0x5d1142b83248298d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d1142b832482994 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787823737.291455:0:15517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787823737.291486:0:15517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e7920eeac00/0x5d1142b83248298d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832482994 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823737.291493:0:15517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787823737.291512:0:15517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e7920eeac00/0x5d1142b83248298d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832482994 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823737.291519:0:15517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e7920eeac00/0x5d1142b83248298d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832482994 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823737.291541:0:15517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787823737.291544:0:15517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e793a26de00/0x5d1142b832482852 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b832482859 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823737.291558:0:15517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26de00 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:1.0:1787823737.291561:0:15517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e793a26de00/0x5d1142b832482852 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d1142b832482859 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823737.291567:0:15517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e793a26de00/0x5d1142b832482852 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d1142b832482859 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787823737.291574:0:15517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e793a26de00/0x5d1142b832482852 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d1142b832482859 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787823737.291579:0:15517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787823737.291592:0:15517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e793a26de00/0x5d1142b832482852 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832482859 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823737.291598:0:15517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787823737.291619:0:15517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e793a26de00/0x5d1142b832482852 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832482859 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823737.291626:0:15517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e793a26de00/0x5d1142b832482852 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b832482859 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823737.291635:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823737.291637:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823737.291639:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823737.291648:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787823737.291660:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a76fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b00b7bac-c389-4a58-8ac8-b4f04764fb77:3307:1874668651911936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787823737.291691:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823737.291723:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787823737.291733:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a76ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b00b7bac-c389-4a58-8ac8-b4f04764fb77:3306:1874668651912064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787823737.291783:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823737.291812:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651911936 00000100:00100000:1.0:1787823737.291816:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651911936 00010000:00010000:1.0:1787823737.291835:0:14302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e793a26c000/0x5d1142b832482994 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b83248298d expref: 19 pid: 14309 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823737.291853:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651912064 00000100:00100000:1.0:1787823737.291855:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651912064 00010000:00010000:1.0:1787823737.291865:0:14302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e793a40f400/0x5d1142b832482859 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b832482852 expref: 20 pid: 14309 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823737.291875:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787823737.291881:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+20:3307:x1874668651911936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787823737.291890:0:14302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823737.291895:0:14302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e793a26c000/0x5d1142b832482994 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b83248298d expref: 20 pid: 14309 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823737.292394:0:14302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e793a26c000/0x5d1142b832482994 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d1142b83248298d expref: 20 pid: 14309 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823737.292410:0:14302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823737.292446:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+20:3307:x1874668651911936:12345-0@lo:103:ldlm_bl.0 Request processed in 565us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823737.292453:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787823737.292471:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787823737.292477:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+19:3306:x1874668651912064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787823737.292485:0:14302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823737.292490:0:14302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e793a40f400/0x5d1142b832482859 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b832482852 expref: 19 pid: 14309 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823737.292497:0:14302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e793a40f400/0x5d1142b832482859 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d1142b832482852 expref: 19 pid: 14309 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823737.292505:0:14302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823737.292592:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+19:3306:x1874668651912064:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823737.292599:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787823737.292635:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a76ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b00b7bac-c389-4a58-8ac8-b4f04764fb77:3306:1874668651912064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787823737.292660:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a76fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b00b7bac-c389-4a58-8ac8-b4f04764fb77:3307:1874668651911936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787823737.292740:0:16425:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908c9f0c0 going to sleep for 11 seconds 00010000:00010000:2.0:1787823737.292780:0:16425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e793a26c000/0x5d1142b832482994 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d1142b83248298d expref: 18 pid: 14309 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823737.292792:0:16425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a0ee580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1874668651911552:0@lo:104: 00010000:00010000:2.0:1787823737.292803:0:16425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e793a40f400/0x5d1142b832482859 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d1142b832482852 expref: 17 pid: 14309 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823737.292811:0:16425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a0eed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1874668651911680:0@lo:104: 00000100:00100000:3.0:1787823737.293200:0:14299:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787823737.293331:0:14299:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1787823737.293346:0:14299:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:3.0:1787823737.293560:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651911808 00000100:00100000:3.0:1787823737.293566:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651911808 00000100:00100000:3.0:1787823737.293659:0:16427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787823737.293667:0:16427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a41c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+4:16425:x1874668651911808:12345-0@lo:104: 00010000:00010000:3.0:1787823737.293679:0:16427:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff8e793a26c600/0x5d1142b832482805 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b83248280c expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823737.293734:0:16427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787823737.293739:0:16427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a41c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+4:16425:x1874668651911808:12345-0@lo:104: Request processed in 74us (2986us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823737.293746:0:16427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1787823737.293887:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787823737.293893:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff8e793a26c600/0x5d1142b832482805 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d1142b83248280c expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823737.293900:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26c600 already unused, calling callback (ffffffffc1c76c20) 10000000:00010000:3.0:1787823737.293973:0:14305:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff8e793a26c600/0x5d1142b832482805 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d1142b83248280c expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823737.293984:0:14305:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff8e793a26c600/0x5d1142b832482805 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d1142b83248280c expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787823737.293991:0:14305:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff8e793a26c600/0x5d1142b832482805 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d1142b83248280c expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787823737.293997:0:14305:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787823737.294026:0:14305:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff8e793a26c600/0x5d1142b832482805 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b83248280c expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823737.294033:0:14305:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787823737.294054:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff8e793a26c600/0x5d1142b832482805 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b83248280c expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823737.294061:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff8e793a26c600/0x5d1142b832482805 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d1142b83248280c expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823737.294075:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823737.294077:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823737.294079:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823737.294090:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787823737.294102:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793f9be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b00b7bac-c389-4a58-8ac8-b4f04764fb77:3305:1874668651912192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787823737.294207:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823737.294423:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823737.294442:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823737.294462:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651912192 00000100:00100000:1.0:1787823737.294466:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651912192 00010000:00010000:1.0:1787823737.294496:0:14302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e793a40ee00/0x5d1142b83248280c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b832482805 expref: 17 pid: 14310 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823737.294510:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629899904 00000100:00100000:1.0:1787823737.294512:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629899904 00010000:00010000:1.0:1787823737.294524:0:14302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e793a26c800/0x5d1142b832482aeb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b32 expref: 13 pid: 14309 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823737.294609:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629900032 00000100:00100000:1.0:1787823737.294612:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629900032 00010000:00010000:1.0:1787823737.294625:0:14302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7900031800/0x5d1142b832482ab3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44ad0 expref: 14 pid: 14310 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823737.294637:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787823737.294644:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793ad50450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+17:3305:x1874668651912192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787823737.294654:0:14302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823737.294660:0:14302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e793a40ee00/0x5d1142b83248280c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d1142b832482805 expref: 17 pid: 14310 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823737.294668:0:14302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e793a40ee00/0x5d1142b83248280c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d1142b832482805 expref: 17 pid: 14310 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823737.294682:0:14302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823737.294719:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793ad50450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+17:3305:x1874668651912192:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823737.294726:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787823737.294898:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 7 00000100:00100000:1.0:1787823737.295205:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+14:2353:x1874668629899904:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787823737.295281:0:14302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823737.295293:0:14302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e793a26c800/0x5d1142b832482aeb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b32 expref: 14 pid: 14309 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823737.295304:0:14302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e793a26c800/0x5d1142b832482aeb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b32 expref: 14 pid: 14309 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823737.295316:0:14302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823737.295357:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+14:2353:x1874668629899904:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 452us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823737.295364:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 7 00000100:00100000:1.0:1787823737.295379:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 8 00000100:00100000:1.0:1787823737.295385:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+13:2353:x1874668629900032:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787823737.295393:0:14302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823737.295397:0:14302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7900031800/0x5d1142b832482ab3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44ad0 expref: 13 pid: 14310 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823737.295406:0:14302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7900031800/0x5d1142b832482ab3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44ad0 expref: 13 pid: 14310 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823737.295417:0:14302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e7900030e00/0x5d1142b832482b15 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823737.295426:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7900030e00/0x5d1142b832482b15 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823737.295440:0:14302:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7900030e00/0x5d1142b832482b15 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823737.295447:0:14302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7900030e00/0x5d1142b832482b15 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823737.295463:0:14302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e7900030e00/0x5d1142b832482b15 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823737.295469:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e7900030e00/0x5d1142b832482b15 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823737.295475:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7900030e00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:1.0:1787823737.295478:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e7900030e00/0x5d1142b832482b15 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823737.295487:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e7900030e00/0x5d1142b832482b15 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823737.295496:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e7900030e00/0x5d1142b832482b15 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823737.295505:0:14302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823737.295525:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+13:2353:x1874668629900032:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 140us (1083us total) trans 0 rc 0/0 00010000:00010000:2.0:1787823737.295618:0:16425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e793a26c800/0x5d1142b832482aeb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b32 expref: 13 pid: 14309 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823737.295631:0:16425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a0eda40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1874668651911296:192.168.202.35@tcp:104: 00010000:00010000:2.0:1787823737.295646:0:16425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7900031800/0x5d1142b832482ab3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44ad0 expref: 12 pid: 14310 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823737.295662:0:16425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a0ec000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1874668651911424:192.168.202.35@tcp:104: 00010000:00010000:2.0:1787823737.295676:0:16425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e793a40ee00/0x5d1142b83248280c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d1142b832482805 expref: 16 pid: 14310 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823737.295685:0:16425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a0ed680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1874668651911808:0@lo:104: 00010000:00010000:2.0:1787823737.295710:0:16425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e7900030e00/0x5d1142b832482b15 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823737.295719:0:16425:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e7900030e00/0x5d1142b832482b15 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823737.295725:0:16425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e7900030e00/0x5d1142b832482b15 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823737.295732:0:16425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7900030e00/0x5d1142b832482b15 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823737.296327:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793f9be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b00b7bac-c389-4a58-8ac8-b4f04764fb77:3305:1874668651912192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787823737.296390:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 8 00010000:00010000:0.0:1787823737.297648:0:14300:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1787823737.297662:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0ede00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+3:16425:x1874668651911680:12345-0@lo:104: Request processed in 6319us (7457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823737.297673:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1787823737.297875:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787823737.706164:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823737.837899:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a0efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651912320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787823737.837978:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823737.838244:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651912320 00000100:00100000:0.0:1787823737.838253:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651912320 00000100:00100000:1.0:1787823737.844308:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787823737.845901:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787823737.845928:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a0eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874668651912832:0@lo:400:kworker.0 00000100:00100000:3.0:1787823737.845997:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823737.846042:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a0ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874668651912576:0@lo:400:kworker.0 00000100:00100000:3.0:1787823737.846067:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823737.846088:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787823737.846093:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a0eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874668651912704:0@lo:400:kworker.0 00000100:00100000:3.0:1787823737.846114:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823737.846156:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651912832 00000100:00100000:3.0:1787823737.846164:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651912832 00000100:00100000:0.0:1787823737.846406:0:15004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787823737.846416:0:15004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651912320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787823737.846451:0:15004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787823737.849538:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a0ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651912448:0@lo:400:kworker.0 00000100:00100000:1.0:1787823737.849624:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823737.851161:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651912576 00000100:00100000:2.0:1787823737.851176:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651912576 00000100:00100000:2.0:1787823737.851243:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651912704 00000100:00100000:2.0:1787823737.851247:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651912704 00000100:00100000:3.0:1787823737.851493:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787823737.851504:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874668651912576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823737.851633:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874668651912576:12345-0@lo:400:kworker.0 Request processed in 130us (5563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823737.851657:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787823737.853428:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787823737.853445:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874668651912832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823737.853540:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874668651912832:12345-0@lo:400:kworker.0 Request processed in 101us (7542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823737.853562:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1787823737.853595:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787823737.853601:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787823737.853612:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651912448 00000100:00100000:3.0:1787823737.853618:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651912448 00000100:00100000:3.0:1787823737.853660:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787823737.853666:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651912448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823737.853710:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651912448:12345-0@lo:400:kworker.0 Request processed in 44us (4086us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823737.853716:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787823737.854105:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a0ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874668651912576:0@lo:400:kworker.0 00000100:00080000:3.0:1787823737.854136:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787823737.854161:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a0eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874668651912832:0@lo:400:kworker.0 00000100:00100000:0.0:1787823737.855069:0:15004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651912320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8647us (17083us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823737.855084:0:15004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787823737.858394:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a0efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651912320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787823737.858441:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a0ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651912448:0@lo:400:kworker.0 00000100:00100000:3.0:1787823737.862364:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787823737.862380:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874668651912704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787823737.862471:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874668651912704:12345-0@lo:400:kworker.0 Request processed in 97us (16357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823737.862478:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787823737.862825:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a0eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874668651912704:0@lo:400:kworker.0 00000100:00100000:1.0:1787823738.347120:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787823738.347144:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a76f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651912960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787823738.347229:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823738.347711:0:15004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651912960 00000100:00100000:0.0:1787823738.347719:0:15004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651912960 00000100:00100000:0.0:1787823738.347798:0:15004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787823738.347809:0:15004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651912960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787823738.347849:0:15004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787823738.347897:0:15004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651912960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823738.348073:0:15004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787823738.348155:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a76f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651912960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787823738.384008:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823738.384079:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629900160 00000100:00100000:1.0:1787823738.384089:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629900160 00000100:00100000:1.0:1787823738.384145:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 104 00000100:00100000:1.0:1787823738.384156:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793510dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+11:13748:x1874668629900160:12345-192.168.202.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787823738.384172:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823738.384190:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7920eebe00/0x5d1142b832482b1c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44b63 expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823738.384229:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7920eebe00/0x5d1142b832482b1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b63 expref: 12 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823738.384240:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7920eebe00/0x5d1142b832482b1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b63 expref: 12 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823738.384250:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7920eebe00, rc 0) 00000100:00100000:1.0:1787823738.384309:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793510dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+12:13748:x1874668629900160:12345-192.168.202.35@tcp:101:ll_cfg_requeue.0 Request processed in 155us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823738.384316:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 104 00000100:00100000:1.0:1787823738.391585:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823738.391664:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629900288 00000100:00100000:2.0:1787823738.391675:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629900288 00000100:00100000:2.0:1787823738.391741:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 105 00000100:00100000:2.0:1787823738.391752:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793510c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+12:13748:x1874668629900288:12345-192.168.202.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787823738.392101:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793510c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+12:13748:x1874668629900288:12345-192.168.202.35@tcp:501:ll_cfg_requeue.0 Request processed in 349us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823738.392122:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 105 00000100:00100000:0.0:1787823738.397173:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823738.397335:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629900416 00000100:00100000:2.0:1787823738.397345:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629900416 00000100:00100000:2.0:1787823738.397454:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 106 00000100:00100000:2.0:1787823738.397466:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793510e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+12:13748:x1874668629900416:12345-192.168.202.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787823738.397746:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793510e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+12:13748:x1874668629900416:12345-192.168.202.35@tcp:503:ll_cfg_requeue.0 Request processed in 281us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823738.397754:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 106 00000100:00100000:3.0:1787823738.405058:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823738.405733:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629900544 00000100:00100000:1.0:1787823738.405744:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629900544 00000100:00100000:1.0:1787823738.405864:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 107 00000100:00100000:1.0:1787823738.405874:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793510e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+12:13748:x1874668629900544:12345-192.168.202.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787823738.405891:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787823738.405907:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7920eeac00/0x5d1142b832482b23 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44b6a expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823738.405942:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7920eeac00/0x5d1142b832482b23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b6a expref: 13 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823738.405953:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7920eeac00/0x5d1142b832482b23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b6a expref: 13 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823738.405962:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7920eeac00, rc 0) 00000100:00100000:1.0:1787823738.406011:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793510e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+13:13748:x1874668629900544:12345-192.168.202.35@tcp:101:ll_cfg_requeue.0 Request processed in 139us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823738.406018:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 107 00000100:00100000:3.0:1787823738.408175:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823738.408391:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629900672 00000100:00100000:2.0:1787823738.408399:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629900672 00000100:00100000:2.0:1787823738.408451:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 108 00000100:00100000:2.0:1787823738.408460:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793510d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+13:13748:x1874668629900672:12345-192.168.202.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787823738.408754:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793510d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+13:13748:x1874668629900672:12345-192.168.202.35@tcp:501:ll_cfg_requeue.0 Request processed in 295us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823738.408805:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 108 00000100:00100000:0.0:1787823738.413437:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823738.414479:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629900800 00000100:00100000:2.0:1787823738.414492:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629900800 00000100:00100000:2.0:1787823738.414661:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 109 00000100:00100000:2.0:1787823738.414674:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793510fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+13:13748:x1874668629900800:12345-192.168.202.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787823738.416315:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793510fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+13:13748:x1874668629900800:12345-192.168.202.35@tcp:503:ll_cfg_requeue.0 Request processed in 1526us (2768us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823738.416329:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 109 00010000:00010000:3.0:1787823738.730037:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787823739.118560:0:14348:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1787823739.177926:0:14313:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787823739.177936:0:14313:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e792ee55800 from 10 10000000:01000000:0.0:1787823739.177941:0:14313:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787823739.177988:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a40e200/0x5d1142b832482b2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823739.178000:0:14313:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e793a40e200/0x5d1142b832482b2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823739.178011:0:14313:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e793a40e200/0x5d1142b832482b2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823739.178051:0:14313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7802e11680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14313:1874668651913088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787823739.178125:0:14313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823739.178170:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651913088 00000100:00100000:3.0:1787823739.178178:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651913088 00000100:00100000:0.0:1787823739.178178:0:14313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793516fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787823739.178235:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787823739.178245:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793510e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+16:14313:x1874668651913088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787823739.178258:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823739.178271:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e793a26c600/0x5d1142b832482b31 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b832482b2a expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823739.178293:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e793a26c600/0x5d1142b832482b31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b832482b2a expref: 17 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823739.178303:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e793a26c600/0x5d1142b832482b31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832482b2a expref: 17 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823739.178312:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a26c600, rc 0) 00000100:00100000:3.0:1787823739.178358:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793510e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+17:14313:x1874668651913088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823739.178365:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787823739.178404:0:14313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7802e11680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14313:1874668651913088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787823739.178419:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e793a40e200/0x5d1142b832482b2a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832482b31 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823739.178428:0:14313:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e793a40e200/0x5d1142b832482b2a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b832482b31 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823739.178479:0:14313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7802e11680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14313:1874668651913216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787823739.178505:0:14313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823739.178530:0:14313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793516fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787823739.178600:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651913216 00000100:00100000:3.0:1787823739.178605:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651913216 00000100:00100000:3.0:1787823739.178632:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787823739.178640:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793510f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+17:14313:x1874668651913216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787823739.178908:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793510f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+17:14313:x1874668651913216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 268us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823739.178924:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787823739.179134:0:14313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7802e11680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14313:1874668651913216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787823739.179162:0:14313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7802e11680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14313:1874668651913344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787823739.179199:0:14313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823739.179224:0:14313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793516fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787823739.179269:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651913344 00000100:00100000:3.0:1787823739.179273:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651913344 00000100:00100000:3.0:1787823739.179304:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787823739.179311:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79100ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+17:14313:x1874668651913344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787823739.179445:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79100ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+17:14313:x1874668651913344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823739.179452:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787823739.179527:0:14313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7802e11680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14313:1874668651913344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787823739.180807:0:16499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787823739.180879:0:14313:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787823739.180895:0:14313:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787823739.180904:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a40e200/0x5d1142b832482b2a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832482b31 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823739.180913:0:14313:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e793a40e200/0x5d1142b832482b2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832482b31 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787823739.180923:0:14313:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787823739.180925:0:14313:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e79187b1000 from 10 10000000:01000000:0.0:1787823739.180928:0:14313:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787823739.180956:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a40e800/0x5d1142b832482b38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823739.180963:0:14313:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e793a40e800/0x5d1142b832482b38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823739.180972:0:14313:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e793a40e800/0x5d1142b832482b38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823739.180990:0:14313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7802e11680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14313:1874668651913472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787823739.181046:0:14313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823739.181090:0:14313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793516fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787823739.181109:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651913472 00000100:00100000:0.0:1787823739.181114:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651913472 00000100:00100000:0.0:1787823739.181148:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787823739.181157:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79100ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+17:14313:x1874668651913472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787823739.181168:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823739.181179:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e793a40ea00/0x5d1142b832482b3f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b832482b38 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823739.181198:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e793a40ea00/0x5d1142b832482b3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b832482b38 expref: 18 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823739.181207:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e793a40ea00/0x5d1142b832482b3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832482b38 expref: 18 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823739.181215:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40ea00, rc 0) 00000100:00100000:0.0:1787823739.181250:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79100ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+18:14313:x1874668651913472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823739.181257:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787823739.181291:0:14313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7802e11680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14313:1874668651913472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787823739.181303:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e793a40e800/0x5d1142b832482b38 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832482b3f expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823739.181311:0:14313:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e793a40e800/0x5d1142b832482b38 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b832482b3f expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823739.181364:0:14313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7802e11680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14313:1874668651913600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787823739.181388:0:14313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823739.181407:0:14313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793516fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787823739.181419:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651913600 00000100:00100000:0.0:1787823739.181423:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651913600 00000100:00100000:0.0:1787823739.181444:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787823739.181451:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79100ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+18:14313:x1874668651913600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787823739.181677:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79100ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+18:14313:x1874668651913600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 225us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823739.181684:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787823739.181713:0:14313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7802e11680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14313:1874668651913600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787823739.181736:0:14313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7802e11680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14313:1874668651913728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787823739.181805:0:14313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823739.181818:0:14313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793516fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787823739.181830:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651913728 00000100:00100000:0.0:1787823739.181833:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651913728 00000100:00100000:0.0:1787823739.181852:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787823739.181858:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79100ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+18:14313:x1874668651913728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787823739.181980:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79100ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+18:14313:x1874668651913728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 121us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823739.181986:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787823739.182021:0:14313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7802e11680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14313:1874668651913728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787823739.188285:0:16501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787823739.188574:0:14313:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787823739.188597:0:14313:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787823739.188608:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a40e800/0x5d1142b832482b38 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832482b3f expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823739.188619:0:14313:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e793a40e800/0x5d1142b832482b38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832482b3f expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787823739.188639:0:14313:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787823739.188642:0:14313:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e79358bc000 from 10 10000000:01000000:0.0:1787823739.188645:0:14313:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787823739.188681:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a40f000/0x5d1142b832482b46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823739.188689:0:14313:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff8e793a40f000/0x5d1142b832482b46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823739.188701:0:14313:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff8e793a40f000/0x5d1142b832482b46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823739.188731:0:14313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7802e11680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14313:1874668651913856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787823739.188848:0:14313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787823739.188898:0:14313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7910029b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787823739.189030:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651913856 00000100:00100000:2.0:1787823739.189153:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651913856 00000100:00100000:2.0:1787823739.189202:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787823739.189212:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79100ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+18:14313:x1874668651913856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787823739.189225:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823739.189238:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7900031400/0x5d1142b832482b4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d1142b832482b46 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823739.189264:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7900031400/0x5d1142b832482b4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d1142b832482b46 expref: 19 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823739.189275:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7900031400/0x5d1142b832482b4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d1142b832482b46 expref: 19 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823739.189283:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7900031400, rc 0) 00000100:00100000:2.0:1787823739.189332:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79100ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b00b7bac-c389-4a58-8ac8-b4f04764fb77+19:14313:x1874668651913856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823739.189340:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787823739.189488:0:14313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7802e11680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14313:1874668651913856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787823739.189503:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff8e793a40f000/0x5d1142b832482b46 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832482b4d expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823739.189512:0:14313:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff8e793a40f000/0x5d1142b832482b46 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d1142b832482b4d expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823739.189585:0:14313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793f9bde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14313:1874668651913984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787823739.189614:0:14313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823739.189637:0:14313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908c9f600 going to sleep for 11 seconds 00000100:00100000:3.0:1787823739.189651:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651913984 00000100:00100000:3.0:1787823739.189655:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651913984 00000100:00100000:3.0:1787823739.189674:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787823739.189681:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79100ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+20:14313:x1874668651913984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787823739.189971:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79100ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+20:14313:x1874668651913984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 289us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823739.189979:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787823739.190020:0:14313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793f9bde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14313:1874668651913984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787823739.190048:0:14313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793f9bde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14313:1874668651914112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787823739.190084:0:14313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823739.190100:0:14313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7908c9f600 going to sleep for 11 seconds 00000100:00100000:3.0:1787823739.190109:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651914112 00000100:00100000:3.0:1787823739.190112:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651914112 00000100:00100000:3.0:1787823739.190127:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787823739.190133:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79100ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+20:14313:x1874668651914112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787823739.190266:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79100ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b00b7bac-c389-4a58-8ac8-b4f04764fb77+20:14313:x1874668651914112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823739.190272:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787823739.190307:0:14313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793f9bde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b00b7bac-c389-4a58-8ac8-b4f04764fb77:14313:1874668651914112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787823739.191678:0:16502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787823739.192165:0:14313:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787823739.192189:0:14313:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787823739.192202:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff8e793a40f000/0x5d1142b832482b46 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832482b4d expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823739.192215:0:14313:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff8e793a40f000/0x5d1142b832482b46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d1142b832482b4d expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823739.753894:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823740.105152:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823740.105205:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823740.105239:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823740.105265:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823740.105288:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823740.105310:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823740.105317:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629901440 00000100:00100000:2.0:1787823740.105331:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629901440 00000100:00100000:3.0:1787823740.105361:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823740.105388:0:16261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629901184 00000100:00100000:3.0:1787823740.105393:0:16261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629901184 00000100:00100000:2.0:1787823740.105406:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629901056 00000100:00100000:2.0:1787823740.105410:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629901056 00000100:00100000:3.0:1787823740.105423:0:16261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629901696 00000100:00100000:3.0:1787823740.105427:0:16261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629901696 00000100:00100000:2.0:1787823740.105444:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 24 00000100:00100000:3.0:1787823740.105447:0:16261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629901312 00000100:00100000:3.0:1787823740.105452:0:16261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629901312 00000100:00100000:2.0:1787823740.105458:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe458d9d-d7c9-49e7-b833-d87e1bb29306+6:2353:x1874668629901440:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787823740.105466:0:16261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629901568 00000100:00100000:3.0:1787823740.105469:0:16261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629901568 00000100:00100000:3.0:1787823740.105484:0:16261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 10 00000100:00100000:3.0:1787823740.105492:0:16261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+5:2353:x1874668629901184:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787823740.105575:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629900928 00000100:00100000:0.0:1787823740.105580:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629900928 00000100:00100000:0.0:1787823740.105608:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 119 00000100:00100000:0.0:1787823740.105614:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79100efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+13:2353:x1874668629900928:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787823740.105730:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe458d9d-d7c9-49e7-b833-d87e1bb29306+6:2353:x1874668629901440:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 275us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823740.105739:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 24 00000100:00100000:1.0:1787823740.105750:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 11 00000100:00100000:2.0:1787823740.105792:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 25 00000100:00100000:1.0:1787823740.105804:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fe458d9d-d7c9-49e7-b833-d87e1bb29306+5:2353:x1874668629901696:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787823740.105824:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+6:2353:x1874668629901056:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787823740.105841:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fe458d9d-d7c9-49e7-b833-d87e1bb29306+5:2353:x1874668629901696:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 81us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823740.105848:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 11 00000100:00100000:2.0:1787823740.105862:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+6:2353:x1874668629901056:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 51us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823740.105867:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 12 00000100:00100000:2.0:1787823740.105873:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 25 00000100:00100000:1.0:1787823740.105878:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+5:2353:x1874668629901312:12345-192.168.202.35@tcp:400:kworker.0 00000100:00080000:2.0:1787823740.105896:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787823740.105902:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787823740.105905:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787823740.105906:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+5:2353:x1874668629901312:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 31us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823740.105924:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 12 00000100:00100000:1.0:1787823740.105939:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 13 00000100:00100000:2.0:1787823740.105944:0:15000:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1787823740.105949:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fe458d9d-d7c9-49e7-b833-d87e1bb29306+5:2353:x1874668629901568:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787823740.105956:0:15000:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1787823740.105982:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fe458d9d-d7c9-49e7-b833-d87e1bb29306+5:2353:x1874668629901568:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 35us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823740.105989:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 13 00000100:00100000:3.0:1787823740.106370:0:16261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+5:2353:x1874668629901184:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 874us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823740.106379:0:16261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 10 00000100:00100000:0.0:1787823740.116094:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79100efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+13:2353:x1874668629900928:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 10462us (10936us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823740.116110:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 119 00010000:00010000:1.0:1787823740.777868:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823741.126093:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823741.126153:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629901824 00000100:00100000:2.0:1787823741.126162:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629901824 00000100:00100000:2.0:1787823741.126240:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 15 00000100:00100000:2.0:1787823741.126251:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793f9bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+6:14403:x1874668629901824:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787823741.126272:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823741.126291:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031a00/0x5d1142b832482b54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44b71 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.126360:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030000/0x5d1142b832482b5b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.126373:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030000/0x5d1142b832482b5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.126385:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030000/0x5d1142b832482b5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.126401:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031800/0x5d1142b832482b62 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.126409:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031800/0x5d1142b832482b62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.126432:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031800/0x5d1142b832482b62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.127292:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030e00/0x5d1142b832482b69 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.127306:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030e00/0x5d1142b832482b69 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.127313:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030e00/0x5d1142b832482b69 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787823741.127403:0:14316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787823741.127407:0:14316:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787823741.127507:0:14316:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030e00/0x5d1142b832482b69 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.127530:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030000/0x5d1142b832482b5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.127537:0:14316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030000/0x5d1142b832482b5b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.127543:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030000/0x5d1142b832482b5b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.127549:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7900030000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823741.127552:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030000/0x5d1142b832482b5b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.127558:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030000/0x5d1142b832482b5b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.127577:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e7917859300) 00010000:00010000:2.0:1787823741.127579:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823741.127584:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030000/0x5d1142b832482b5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.127590:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030000/0x5d1142b832482b5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.127602:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031800/0x5d1142b832482b62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.127607:0:14316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031800/0x5d1142b832482b62 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.127613:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031800/0x5d1142b832482b62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.127617:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7900031800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823741.127619:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031800/0x5d1142b832482b62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.127624:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031800/0x5d1142b832482b62 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.127631:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8e79228da600) 00010000:00010000:2.0:1787823741.127633:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823741.127635:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031800/0x5d1142b832482b62 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.127641:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031800/0x5d1142b832482b62 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.127686:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031a00/0x5d1142b832482b54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b71 expref: 8 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.127699:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030e00/0x5d1142b832482b69 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b71 expref: 7 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.127707:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e79228da900) 00010000:00010000:2.0:1787823741.127709:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787823741.127711:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7900030e00, rc 0) 00000100:00100000:2.0:1787823741.129481:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793f9bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+7:14403:x1874668629901824:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 3219us (3386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823741.129495:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 15 00000100:00100000:3.0:1787823741.132155:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823741.132655:0:15477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629902080 00000100:00100000:2.0:1787823741.132665:0:15477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629902080 00000100:00100000:2.0:1787823741.132735:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 16 00000100:00100000:2.0:1787823741.132746:0:15477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+7:14403:x1874668629902080:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787823741.132794:0:15477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823741.132819:0:15477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030800/0x5d1142b832482b70 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44b78 expref: -99 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.132897:0:15477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3c00/0x5d1142b832482b77 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.132913:0:15477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3c00/0x5d1142b832482b77 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.132926:0:15477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3c00/0x5d1142b832482b77 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.133323:0:15477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482b7e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.133333:0:15477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482b7e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.133340:0:15477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482b7e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.137343:0:15477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482b85 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.137364:0:15477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482b85 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.137376:0:15477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482b85 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787823741.137390:0:15477:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787823741.138294:0:15477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3c00/0x5d1142b832482b77 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.138307:0:15477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3c00/0x5d1142b832482b77 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.138314:0:15477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3c00/0x5d1142b832482b77 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.138320:0:15477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3c00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823741.138325:0:15477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3c00/0x5d1142b832482b77 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.138345:0:15477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3c00/0x5d1142b832482b77 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.138364:0:15477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e79228da900) 00010000:00010000:2.0:1787823741.138367:0:15477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823741.138373:0:15477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3c00/0x5d1142b832482b77 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.138379:0:15477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3c00/0x5d1142b832482b77 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.138393:0:15477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482b7e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.138398:0:15477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482b7e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.138405:0:15477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482b7e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.138410:0:15477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d2800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823741.138413:0:15477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482b7e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.138418:0:15477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482b7e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.138425:0:15477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8e79228dab00) 00010000:00010000:2.0:1787823741.138427:0:15477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823741.138430:0:15477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482b7e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.139200:0:15477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482b7e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.140400:0:15477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900030800/0x5d1142b832482b70 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b78 expref: 10 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.140426:0:15477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3a00/0x5d1142b832482b85 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b78 expref: 9 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.140675:0:15477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e79228da200) 00010000:00010000:2.0:1787823741.140679:0:15477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823741.140683:0:15477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d3a00, rc 0) 00000100:00100000:2.0:1787823741.141901:0:15477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+9:14403:x1874668629902080:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 9145us (9747us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787823741.141918:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 16 00000100:00100000:0.0:1787823741.150901:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823741.151115:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629902208 00000100:00100000:2.0:1787823741.151126:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629902208 00000100:00100000:2.0:1787823741.151186:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 17 00000100:00100000:2.0:1787823741.151197:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7802e12d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+9:14403:x1874668629902208:12345-192.168.202.35@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787823741.151308:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7802e12d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+9:14403:x1874668629902208:12345-192.168.202.35@tcp:59:lhsmtool_posix.0 Request processed in 113us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823741.151316:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 17 00000040:00080000:3.0:1787823741.162422:0:14348:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787823741.181607:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823741.182213:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629902336 00000100:00100000:2.0:1787823741.182224:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629902336 00000100:00100000:3.0:1787823741.182464:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 18 00000100:00100000:3.0:1787823741.182476:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+9:14409:x1874668629902336:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:3.0:1787823741.182497:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823741.182534:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832482b93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44b7f expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.182602:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482b9a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.182618:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482b9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.182650:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482b9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.182737:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d400/0x5d1142b832482ba1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.182746:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d400/0x5d1142b832482ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.182753:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d400/0x5d1142b832482ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.183827:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482b9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.183839:0:14318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482b9a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.183846:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482b9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.183927:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26ce00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823741.183933:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482b9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.183941:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482b9a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.183955:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e7917859300) 00010000:00010000:3.0:1787823741.183958:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787823741.183963:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482b9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.183976:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482b9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.183990:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d400/0x5d1142b832482ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.183997:0:14318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d400/0x5d1142b832482ba1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.184002:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d400/0x5d1142b832482ba1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.184007:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26d400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823741.184010:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d400/0x5d1142b832482ba1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.184016:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d400/0x5d1142b832482ba1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.184024:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e79032ec400) 00010000:00010000:3.0:1787823741.184026:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787823741.184029:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d400/0x5d1142b832482ba1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.184035:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d400/0x5d1142b832482ba1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.184072:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832482b93 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b7f expref: 10 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.184094:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e7917859300) 00010000:00010000:3.0:1787823741.184097:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787823741.184101:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832482b93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b7f expref: 10 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.184110:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a26d000, rc 0) 00000100:00100000:3.0:1787823741.184172:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+9:14409:x1874668629902336:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 1698us (2577us total) trans 0 rc 301/301 00000100:00100000:3.0:1787823741.184181:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 18 00000100:00100000:1.0:1787823741.190356:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823741.190532:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629902464 00000100:00100000:0.0:1787823741.190541:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629902464 00000100:00100000:0.0:1787823741.190628:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 0 00000100:00100000:0.0:1787823741.190639:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+9:14409:x1874668629902464:12345-192.168.202.35@tcp:700:lfs.0 00000100:00100000:0.0:1787823741.190783:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+9:14409:x1874668629902464:12345-192.168.202.35@tcp:700:lfs.0 Request processed in 145us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823741.190791:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 0 00000100:00100000:1.0:1787823741.192740:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823741.193062:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629902720 00000100:00100000:2.0:1787823741.193072:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629902720 00000100:00100000:2.0:1787823741.193169:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 19 00000100:00100000:2.0:1787823741.193180:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+9:14409:x1874668629902720:12345-192.168.202.35@tcp:36:lfs.0 00010000:00010000:2.0:1787823741.193238:0:14317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787823741.193276:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeb600/0x5d1142b832482ad6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44afa expref: 9 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.193295:0:14317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e7917859300) 00010000:00010000:2.0:1787823741.193300:0:14317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787823741.193576:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482ba8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.193591:0:14317:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031000/0x5d1142b832482b0e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b5c expref: 5 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.193601:0:14317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482ba8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.193632:0:14317:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031000/0x5d1142b832482b0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b5c expref: 5 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.193647:0:14317:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031000/0x5d1142b832482b0e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b5c expref: 5 pid: 15477 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823741.193805:0:14317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a0ee580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14317:1874668651914240:192.168.202.35@tcp:104: 00000100:00100000:2.0:1787823741.194041:0:14317:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7904944c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787823741.197211:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823741.198009:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629902848 00000100:00100000:1.0:1787823741.198019:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629902848 00010000:00010000:1.0:1787823741.198067:0:14302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031000/0x5d1142b832482b0e lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b5c expref: 6 pid: 15477 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823741.198110:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00100000:1.0:1787823741.198120:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0ec780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fe458d9d-d7c9-49e7-b833-d87e1bb29306+6:2352:x1874668629902848:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787823741.198135:0:14302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823741.198141:0:14302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031000/0x5d1142b832482b0e lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b5c expref: 6 pid: 15477 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823741.198156:0:14302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031000/0x5d1142b832482b0e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b5c expref: 6 pid: 15477 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823741.198179:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e7917859300) 00010000:00010000:1.0:1787823741.198186:0:14302:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482ba8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823741.198210:0:14302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482ba8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823741.198218:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482ba8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823741.198237:0:14302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823741.198431:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0ec780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fe458d9d-d7c9-49e7-b833-d87e1bb29306+6:2352:x1874668629902848:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 312us (1229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823741.198440:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 9 00010000:00010000:0.0:1787823741.198545:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7900031000/0x5d1142b832482b0e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b5c expref: 5 pid: 15477 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823741.198565:0:14317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a0ee580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14317:1874668651914240:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787823741.198586:0:14317:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482ba8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.198595:0:14317:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482ba8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.198601:0:14317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482ba8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.198624:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482baf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.198635:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482baf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.198643:0:14317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482baf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787823741.200143:0:14317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787823741.200158:0:14317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482ba8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.200168:0:14317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482ba8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.200182:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482ba8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.200189:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d2800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823741.200193:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482ba8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.200202:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482ba8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.200217:0:14317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e7917859300) 00010000:00010000:0.0:1787823741.200220:0:14317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823741.200224:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482ba8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.200230:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482ba8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787823741.200249:0:14317:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fe7ea8e6 reply state 00000000c5b0b73c transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482baf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823741.200259:0:14317:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787823741.200354:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+10:14409:x1874668629902720:12345-192.168.202.35@tcp:36:lfs.0 Request processed in 7173us (7620us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787823741.200363:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 19 00010000:00010000:2.0:1787823741.202895:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482baf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.202927:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482baf lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.202935:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482baf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.202942:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40f600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823741.202946:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482baf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.202955:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482baf lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.202970:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e791767b200) 00010000:00010000:2.0:1787823741.202974:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823741.202978:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482baf lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.202984:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482baf lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823741.283019:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823741.283290:0:15477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629902976 00000100:00100000:3.0:1787823741.283300:0:15477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629902976 00000100:00100000:3.0:1787823741.283356:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 20 00000100:00100000:3.0:1787823741.283364:0:15477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+9:14417:x1874668629902976:12345-192.168.202.35@tcp:101:lctl.0 00010000:00010000:3.0:1787823741.283386:0:15477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823741.283406:0:15477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832482bb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44b86 expref: -99 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.283475:0:15477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d400/0x5d1142b832482bbd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.283489:0:15477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d400/0x5d1142b832482bbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.283499:0:15477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d400/0x5d1142b832482bbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787823741.283580:0:15477:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787823741.283593:0:15477:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1787823741.283632:0:15477:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d400/0x5d1142b832482bbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.283664:0:15477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832482bb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b86 expref: 11 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.283684:0:15477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d400/0x5d1142b832482bbd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b86 expref: 10 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.283693:0:15477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e79032ec400) 00010000:00010000:3.0:1787823741.283696:0:15477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787823741.283699:0:15477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a26d400, rc 0) 00000100:00100000:3.0:1787823741.283753:0:15477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+10:14417:x1874668629902976:12345-192.168.202.35@tcp:101:lctl.0 Request processed in 390us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823741.284260:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 20 00000100:00100000:3.0:1787823741.311132:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823741.311307:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629903104 00000100:00100000:2.0:1787823741.311317:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629903104 00000100:00100000:2.0:1787823741.311382:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 21 00000100:00100000:2.0:1787823741.311392:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe458d9d-d7c9-49e7-b833-d87e1bb29306+5:14418:x1874668629903104:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:2.0:1787823741.311412:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823741.311432:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832482bc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44b8d expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.311542:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482bcb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.311557:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482bcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.311569:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482bcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787823741.311635:0:14316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787823741.311639:0:14316:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1787823741.311680:0:14316:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482bcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.311709:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832482bc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b8d expref: 7 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.311728:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3400/0x5d1142b832482bcb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b8d expref: 6 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.311737:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e79032ec400) 00010000:00010000:2.0:1787823741.311740:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787823741.311744:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d3400, rc 0) 00000100:00100000:2.0:1787823741.312164:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe458d9d-d7c9-49e7-b833-d87e1bb29306+6:14418:x1874668629903104:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 771us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823741.312172:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 21 00000100:00100000:2.0:1787823741.317940:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823741.318125:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629903232 00000100:00100000:0.0:1787823741.318134:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629903232 00000100:00100000:0.0:1787823741.318205:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 22 00000100:00100000:0.0:1787823741.318216:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe458d9d-d7c9-49e7-b833-d87e1bb29306+6:14418:x1874668629903232:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787823741.318263:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823741.318283:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832482bd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44b94 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.318349:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482bd9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.318364:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482bd9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.318375:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482bd9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.318388:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832482be0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.318395:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832482be0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.318402:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832482be0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.318505:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482be7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.318521:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482be7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.318528:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482be7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787823741.318561:0:14318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787823741.318569:0:14318:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787823741.318591:0:14318:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482be7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.318602:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482bd9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.318608:0:14318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482bd9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.318615:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482bd9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.318621:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40f600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823741.318624:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482bd9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.318631:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482bd9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.318642:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e79032ec400) 00010000:00010000:0.0:1787823741.318645:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823741.318649:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482bd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.318655:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482bd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.318908:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832482be0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.318914:0:14318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832482be0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.318929:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832482be0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.318934:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40fe00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823741.318937:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832482be0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.318942:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832482be0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.318950:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e791767ba00) 00010000:00010000:0.0:1787823741.318952:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787823741.318955:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832482be0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.318962:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832482be0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.318993:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832482bd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b94 expref: 8 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.319006:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482be7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b94 expref: 7 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.319014:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e791767b900) 00010000:00010000:0.0:1787823741.319016:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787823741.319018:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40ec00, rc 0) 00000100:00100000:0.0:1787823741.319115:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe458d9d-d7c9-49e7-b833-d87e1bb29306+7:14418:x1874668629903232:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 900us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823741.319132:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 22 00000100:00100000:0.0:1787823741.323938:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823741.324067:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629903488 00000100:00100000:2.0:1787823741.324091:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629903488 00000100:00100000:2.0:1787823741.324153:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 23 00000100:00100000:2.0:1787823741.324164:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7802e130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe458d9d-d7c9-49e7-b833-d87e1bb29306+7:14418:x1874668629903488:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:2.0:1787823741.324184:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823741.324205:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3600/0x5d1142b832482bee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44b9b expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787823741.324329:0:14317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787823741.324460:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3600/0x5d1142b832482bee lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b9b expref: 9 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.324473:0:14317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e79032ec400) 00010000:00010000:2.0:1787823741.324476:0:14317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787823741.324482:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3600/0x5d1142b832482bee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b9b expref: 9 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.324496:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d3600, rc 0) 00000100:00100000:2.0:1787823741.324569:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7802e130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe458d9d-d7c9-49e7-b833-d87e1bb29306+8:14418:x1874668629903488:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 407us (641us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1787823741.324576:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 23 00000100:00100000:2.0:1787823741.327507:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823741.327673:0:15477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629903744 00000100:00100000:3.0:1787823741.327683:0:15477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629903744 00000100:00100000:3.0:1787823741.327741:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 24 00000100:00100000:3.0:1787823741.327753:0:15477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe458d9d-d7c9-49e7-b833-d87e1bb29306+8:14418:x1874668629903744:12345-192.168.202.35@tcp:36:lfs.0 00010000:00010000:3.0:1787823741.327836:0:15477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787823741.327874:0:15477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ec00/0x5d1142b832482be7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44b94 expref: 8 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.327893:0:15477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e791767b900) 00010000:00010000:3.0:1787823741.327903:0:15477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787823741.327927:0:15477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832482bfc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.327952:0:15477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832482bfc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.327963:0:15477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832482bfc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787823741.328186:0:15477:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000035ac14ad reply state 000000005eac4c57 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832482bfc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823741.328195:0:15477:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787823741.328208:0:15477:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:3.0:1787823741.328289:0:15477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe458d9d-d7c9-49e7-b833-d87e1bb29306+9:14418:x1874668629903744:12345-192.168.202.35@tcp:36:lfs.0 Request processed in 538us (791us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787823741.328297:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 24 00010000:00010000:2.0:1787823741.330574:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832482bfc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.330590:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832482bfc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.330598:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832482bfc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.330621:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26d000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823741.330626:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832482bfc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.330635:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832482bfc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.330652:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e79032ec500) 00010000:00010000:2.0:1787823741.330655:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1787823741.330670:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832482bfc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.330678:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832482bfc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823741.332911:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823741.333133:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629904000 00000100:00100000:0.0:1787823741.333143:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629904000 00000100:00100000:0.0:1787823741.333200:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 2 00000100:00100000:0.0:1787823741.333209:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fe458d9d-d7c9-49e7-b833-d87e1bb29306+8:14418:x1874668629904000:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:0.0:1787823741.333617:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fe458d9d-d7c9-49e7-b833-d87e1bb29306+9:14418:x1874668629904000:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 407us (715us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787823741.333625:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 2 00000100:00100000:1.0:1787823741.336866:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823741.337101:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629904256 00000100:00100000:2.0:1787823741.337112:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629904256 00000100:00100000:2.0:1787823741.337173:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 25 00000100:00100000:2.0:1787823741.337183:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe458d9d-d7c9-49e7-b833-d87e1bb29306+9:14418:x1874668629904256:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:2.0:1787823741.337207:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823741.337227:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2000/0x5d1142b832482c03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44ba2 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.337310:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2400/0x5d1142b832482c0a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.337325:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2400/0x5d1142b832482c0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.337355:0:14317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2400/0x5d1142b832482c0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.337371:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482c11 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.337378:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482c11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.337384:0:14317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482c11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787823741.337646:0:14317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787823741.337747:0:14317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2400/0x5d1142b832482c0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.337755:0:14317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2400/0x5d1142b832482c0a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.337788:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2400/0x5d1142b832482c0a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.337794:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d2400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823741.337799:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2400/0x5d1142b832482c0a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.337807:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2400/0x5d1142b832482c0a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.337820:0:14317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e79032ec400) 00010000:00010000:2.0:1787823741.337823:0:14317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823741.337836:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2400/0x5d1142b832482c0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.337843:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2400/0x5d1142b832482c0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.337972:0:14317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482c11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.337980:0:14317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482c11 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.337986:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482c11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.337990:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823741.337993:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482c11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.337999:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482c11 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.338006:0:14317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e79228dab00) 00010000:00010000:2.0:1787823741.338009:0:14317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823741.338012:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482c11 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.338017:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482c11 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.338057:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2000/0x5d1142b832482c03 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44ba2 expref: 11 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.338080:0:14317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e79032ec400) 00010000:00010000:2.0:1787823741.338082:0:14317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787823741.338086:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2000/0x5d1142b832482c03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44ba2 expref: 11 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.338096:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d2000, rc 0) 00000100:00100000:2.0:1787823741.338205:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe458d9d-d7c9-49e7-b833-d87e1bb29306+10:14418:x1874668629904256:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 1022us (1358us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1787823741.338213:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 25 00000100:00100000:2.0:1787823741.341508:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823741.341643:0:15477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629904384 00000100:00100000:3.0:1787823741.341653:0:15477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629904384 00000100:00100000:3.0:1787823741.341719:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 26 00000100:00100000:3.0:1787823741.341729:0:15477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe458d9d-d7c9-49e7-b833-d87e1bb29306+10:14418:x1874668629904384:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:3.0:1787823741.341751:0:15477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823741.341809:0:15477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482c1f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44ba9 expref: -99 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.341907:0:15477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482c26 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.341922:0:15477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482c26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.341933:0:15477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482c26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787823741.341994:0:15477:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787823741.341998:0:15477:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787823741.342017:0:15477:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482c26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.342043:0:15477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482c1f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44ba9 expref: 12 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.342060:0:15477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482c26 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44ba9 expref: 11 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.342069:0:15477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e79032ec800) 00010000:00010000:3.0:1787823741.342072:0:15477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787823741.342076:0:15477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a26de00, rc 0) 00000100:00100000:3.0:1787823741.342125:0:15477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe458d9d-d7c9-49e7-b833-d87e1bb29306+11:14418:x1874668629904384:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 399us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823741.342132:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 26 00000100:00100000:3.0:1787823741.346209:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823741.346308:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629904512 00000100:00100000:0.0:1787823741.346318:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629904512 00000100:00100000:0.0:1787823741.346373:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 3 00000100:00100000:0.0:1787823741.346382:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fe458d9d-d7c9-49e7-b833-d87e1bb29306+11:14418:x1874668629904512:12345-192.168.202.35@tcp:37:lfs.0 00000100:00100000:0.0:1787823741.351535:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fe458d9d-d7c9-49e7-b833-d87e1bb29306+11:14418:x1874668629904512:12345-192.168.202.35@tcp:37:lfs.0 Request processed in 5133us (5317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823741.351548:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 3 00000100:00100000:3.0:1787823741.355021:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823741.355193:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629904768 00000100:00100000:1.0:1787823741.355204:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629904768 00000100:00100000:1.0:1787823741.355359:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 4 00000100:00100000:1.0:1787823741.355371:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e78011f7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fe458d9d-d7c9-49e7-b833-d87e1bb29306+11:14418:x1874668629904768:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:1.0:1787823741.355652:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e78011f7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fe458d9d-d7c9-49e7-b833-d87e1bb29306+12:14418:x1874668629904768:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 282us (639us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1787823741.355668:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 4 00000100:00100000:3.0:1787823741.424053:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823741.424232:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629904896 00000100:00100000:2.0:1787823741.424242:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629904896 00000100:00100000:2.0:1787823741.424398:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 27 00000100:00100000:2.0:1787823741.424410:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+10:14424:x1874668629904896:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:2.0:1787823741.424430:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823741.424462:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2400/0x5d1142b832482c2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44bb0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.424544:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482c34 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.424560:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482c34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.424573:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482c34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.424607:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2000/0x5d1142b832482c3b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.424615:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2000/0x5d1142b832482c3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.424621:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2000/0x5d1142b832482c3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.424741:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3600/0x5d1142b832482c42 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.424750:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3600/0x5d1142b832482c42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.424780:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3600/0x5d1142b832482c42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787823741.424814:0:14316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787823741.424818:0:14316:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787823741.424877:0:14316:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3600/0x5d1142b832482c42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.424889:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482c34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.424895:0:14316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482c34 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.424902:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482c34 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.424919:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823741.424923:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482c34 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.424931:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482c34 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.424945:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e79032ec400) 00010000:00010000:2.0:1787823741.424947:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823741.424952:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482c34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.424958:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482c34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.424972:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2000/0x5d1142b832482c3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.424978:0:14316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2000/0x5d1142b832482c3b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.424984:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2000/0x5d1142b832482c3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.424989:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d2000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823741.424992:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2000/0x5d1142b832482c3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.424998:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2000/0x5d1142b832482c3b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.425017:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e79228dab00) 00010000:00010000:2.0:1787823741.425020:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823741.425023:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2000/0x5d1142b832482c3b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.425030:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2000/0x5d1142b832482c3b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.425059:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2400/0x5d1142b832482c2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44bb0 expref: 12 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.425072:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3600/0x5d1142b832482c42 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44bb0 expref: 11 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.425080:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e79032ec800) 00010000:00010000:2.0:1787823741.425082:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787823741.425085:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d3600, rc 0) 00000100:00100000:2.0:1787823741.425156:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+11:14424:x1874668629904896:12345-192.168.202.35@tcp:101:bash.0 Request processed in 748us (1307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823741.425163:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 27 00000100:00100000:1.0:1787823741.428390:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823741.428545:0:15477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629905152 00000100:00100000:3.0:1787823741.428554:0:15477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629905152 00000100:00100000:3.0:1787823741.428610:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 28 00000100:00100000:3.0:1787823741.428621:0:15477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a76e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+11:14424:x1874668629905152:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:3.0:1787823741.428642:0:15477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823741.428675:0:15477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482c49 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44bb7 expref: -99 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.428850:0:15477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b832482c50 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.428997:0:15477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482c26 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44ba9 expref: 11 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.429006:0:15477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b832482c50 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.429042:0:15477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482c26 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44ba9 expref: 11 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.429055:0:15477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482c26 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44ba9 expref: 11 pid: 15477 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823741.429069:0:15477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4ea1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15477:1874668651914368:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787823741.429157:0:15477:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e790afdb540 going to sleep for 11 seconds 00000100:00100000:1.0:1787823741.431948:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823741.432025:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629905280 00000100:00100000:0.0:1787823741.432034:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629905280 00010000:00010000:0.0:1787823741.432072:0:14301:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482c26 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44ba9 expref: 12 pid: 15477 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823741.432113:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 10 00000100:00100000:0.0:1787823741.432123:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fe458d9d-d7c9-49e7-b833-d87e1bb29306+12:2352:x1874668629905280:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787823741.432138:0:14301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787823741.432145:0:14301:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482c26 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44ba9 expref: 12 pid: 15477 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.432171:0:14301:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482c26 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44ba9 expref: 12 pid: 15477 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.432194:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e79032ec800) 00010000:00010000:0.0:1787823741.432199:0:14301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b832482c50 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.432209:0:14301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b832482c50 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.432217:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b832482c50 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.432247:0:14301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787823741.432296:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fe458d9d-d7c9-49e7-b833-d87e1bb29306+12:2352:x1874668629905280:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 174us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823741.432304:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 10 00010000:00010000:3.0:1787823741.432584:0:15477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482c26 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44ba9 expref: 11 pid: 15477 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823741.432604:0:15477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4ea1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15477:1874668651914368:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787823741.432625:0:15477:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b832482c50 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.432635:0:15477:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b832482c50 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.432653:0:15477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b832482c50 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.432685:0:15477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c000/0x5d1142b832482c57 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.432695:0:15477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c000/0x5d1142b832482c57 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.432703:0:15477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c000/0x5d1142b832482c57 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.434399:0:15477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832482c5e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.434419:0:15477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832482c5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.434429:0:15477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832482c5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787823741.434568:0:15477:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787823741.434611:0:15477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b832482c50 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.434619:0:15477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b832482c50 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.434625:0:15477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b832482c50 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.434631:0:15477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26c800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823741.434647:0:15477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b832482c50 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.434713:0:15477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b832482c50 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.434728:0:15477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e79032ec800) 00010000:00010000:3.0:1787823741.434731:0:15477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787823741.434735:0:15477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b832482c50 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.434742:0:15477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b832482c50 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787823741.434754:0:15477:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a2f6030 reply state 0000000092f66502 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c000/0x5d1142b832482c57 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823741.434783:0:15477:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787823741.434823:0:15477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482c49 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44bb7 expref: 14 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.434838:0:15477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832482c5e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44bb7 expref: 13 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823741.434845:0:15477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e79032ec100) 00010000:00010000:3.0:1787823741.434847:0:15477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1787823741.434849:0:15477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a26d000, rc 0) 00000100:00100000:3.0:1787823741.435095:0:15477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a76e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+14:14424:x1874668629905152:12345-192.168.202.35@tcp:101:bash.0 Request processed in 6474us (6714us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1787823741.435104:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 28 00010000:00010000:2.0:1787823741.443308:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c000/0x5d1142b832482c57 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.443327:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c000/0x5d1142b832482c57 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.443334:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c000/0x5d1142b832482c57 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.443361:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26c000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823741.443365:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c000/0x5d1142b832482c57 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.443373:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c000/0x5d1142b832482c57 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.443390:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8e79032ec600) 00010000:00010000:2.0:1787823741.443393:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823741.443398:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c000/0x5d1142b832482c57 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.443404:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c000/0x5d1142b832482c57 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823741.452695:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823741.452904:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629905408 00000100:00100000:0.0:1787823741.452914:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629905408 00000100:00100000:0.0:1787823741.452976:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 29 00000100:00100000:0.0:1787823741.452986:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+13:14424:x1874668629905408:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:0.0:1787823741.453011:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823741.453037:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832482c6c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44bbe expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.453115:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482c73 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.453146:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482c73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.453159:0:14317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482c73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787823741.453201:0:14317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787823741.453206:0:14317:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787823741.453227:0:14317:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482c73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.453252:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482c73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.453278:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832482c6c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44bbe expref: 15 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.453297:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482c73 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44bbe expref: 14 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.453305:0:14317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e79032ec100) 00010000:00010000:0.0:1787823741.453308:0:14317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787823741.453311:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40f600, rc 0) 00000100:00100000:0.0:1787823741.453586:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+14:14424:x1874668629905408:12345-192.168.202.35@tcp:101:bash.0 Request processed in 601us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823741.453594:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 29 00000100:00100000:1.0:1787823741.457816:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823741.457968:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629905664 00000100:00100000:0.0:1787823741.457978:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629905664 00000100:00100000:0.0:1787823741.458025:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 5 00000100:00100000:0.0:1787823741.458048:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+14:14424:x1874668629905664:12345-192.168.202.35@tcp:35:bash.0 00000100:00100000:0.0:1787823741.458425:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+15:14424:x1874668629905664:12345-192.168.202.35@tcp:35:bash.0 Request processed in 377us (620us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1787823741.459086:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 5 00000100:00100000:3.0:1787823741.557543:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823741.557666:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629905920 00000100:00100000:2.0:1787823741.557677:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629905920 00000100:00100000:2.0:1787823741.557747:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 30 00000100:00100000:2.0:1787823741.557781:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+15:14434:x1874668629905920:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:2.0:1787823741.557806:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823741.557828:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2400/0x5d1142b832482c7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44bc5 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787823741.557953:0:14316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787823741.558078:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2400/0x5d1142b832482c7a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44bc5 expref: 17 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.558092:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e79032ec400) 00010000:00010000:2.0:1787823741.558107:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787823741.558113:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2400/0x5d1142b832482c7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44bc5 expref: 17 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.558127:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d2400, rc 0) 00000100:00100000:2.0:1787823741.558193:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+16:14434:x1874668629905920:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 437us (660us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1787823741.558200:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 30 00000100:00100000:3.0:1787823741.562584:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823741.562953:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629906176 00000100:00100000:0.0:1787823741.562963:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629906176 00000100:00100000:0.0:1787823741.563018:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 6 00000100:00100000:0.0:1787823741.563028:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+16:14434:x1874668629906176:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:0.0:1787823741.563289:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+17:14434:x1874668629906176:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 261us (713us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1787823741.563297:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 6 00000100:00100000:1.0:1787823741.594651:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823741.596746:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629906432 00000100:00100000:2.0:1787823741.596781:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629906432 00000100:00100000:2.0:1787823741.597017:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 31 00000100:00100000:2.0:1787823741.597030:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+17:14437:x1874668629906432:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:2.0:1787823741.597054:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823741.597076:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2400/0x5d1142b832482c88 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44bcc expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.597200:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2000/0x5d1142b832482c8f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.597215:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2000/0x5d1142b832482c8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.597227:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2000/0x5d1142b832482c8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787823741.597238:0:14318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787823741.597361:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2400/0x5d1142b832482c88 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44bcc expref: 20 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.597390:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2000/0x5d1142b832482c8f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44bcc expref: 19 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.597396:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e79032ec100) 00010000:00010000:2.0:1787823741.597398:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787823741.597400:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d2000, rc 0) 00000100:00100000:2.0:1787823741.597466:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+19:14437:x1874668629906432:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 439us (2825us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1787823741.597473:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 31 00000100:00100000:3.0:1787823741.604568:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823741.604612:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823741.604627:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629906688 00000100:00100000:2.0:1787823741.604637:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629906688 00000100:00100000:2.0:1787823741.604698:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 32 00000100:00100000:2.0:1787823741.604716:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+19:14437:x1874668629906688:12345-192.168.202.35@tcp:54:lfs.0 00010000:00010000:2.0:1787823741.604932:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482c9d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.604950:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482c9d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.604962:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482c9d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.604987:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482c9d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.604994:0:14316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482c9d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.605019:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482c9d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.605025:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823741.605029:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482c9d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.605037:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482c9d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.605049:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e79032ec100) 00010000:00010000:2.0:1787823741.605052:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787823741.605056:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482c9d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823741.605063:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482c9d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823741.605148:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+19:14437:x1874668629906688:12345-192.168.202.35@tcp:54:lfs.0 Request processed in 434us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823741.605156:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 32 00000100:00100000:3.0:1787823741.609016:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823741.609559:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629906560 00000100:00100000:1.0:1787823741.609571:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629906560 00000100:00100000:1.0:1787823741.609798:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 0 00000100:00100000:1.0:1787823741.609810:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4eb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+19:2353:x1874668629906560:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787823741.609841:0:14302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823741.609869:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2000/0x5d1142b832482c8f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44bcc expref: 19 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823741.609888:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e79032ec100) 00010000:00010000:1.0:1787823741.609893:0:14302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823741.609962:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4eb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+18:2353:x1874668629906560:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 154us (5349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823741.609970:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 0 00000100:00100000:0.0:1787823741.610313:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629906944 00000100:00100000:0.0:1787823741.610318:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629906944 00000100:00100000:0.0:1787823741.610354:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 7 00000100:00100000:0.0:1787823741.610362:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+18:14437:x1874668629906944:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:0.0:1787823741.610642:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+19:14437:x1874668629906944:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 280us (1637us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1787823741.610650:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 7 00010000:00010000:3.0:1787823741.802052:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823741.906276:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823741.906428:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629907200 00000100:00100000:0.0:1787823741.906439:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629907200 00000100:00100000:0.0:1787823741.906502:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 33 00000100:00100000:0.0:1787823741.906521:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+19:14468:x1874668629907200:12345-192.168.202.35@tcp:101:cat.0 00010000:00010000:0.0:1787823741.906549:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823741.906569:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832482ca4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44bd3 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.906680:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f400/0x5d1142b832482cab lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.906707:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f400/0x5d1142b832482cab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.906719:0:14317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f400/0x5d1142b832482cab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787823741.906731:0:14317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787823741.906912:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40fe00/0x5d1142b832482ca4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44bd3 expref: 22 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.906931:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f400/0x5d1142b832482cab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44bd3 expref: 21 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823741.906939:0:14317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e79032ec100) 00010000:00010000:0.0:1787823741.906942:0:14317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787823741.906946:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40f400, rc 0) 00000100:00100000:0.0:1787823741.907165:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+21:14468:x1874668629907200:12345-192.168.202.35@tcp:101:cat.0 Request processed in 655us (899us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1787823741.907171:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 33 00000100:00100000:3.0:1787823741.916179:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823741.916303:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629907456 00000100:00100000:1.0:1787823741.916314:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629907456 00000100:00100000:1.0:1787823741.916377:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 8 00000100:00100000:1.0:1787823741.916388:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+21:14468:x1874668629907456:12345-192.168.202.35@tcp:35:cat.0 00000100:00100000:1.0:1787823741.917091:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+22:14468:x1874668629907456:12345-192.168.202.35@tcp:35:cat.0 Request processed in 701us (918us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1787823741.917100:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 8 00000100:00100000:3.0:1787823741.921536:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823741.921892:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629907584 00000100:00100000:1.0:1787823741.921903:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629907584 00000100:00100000:1.0:1787823741.921973:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 1 00000100:00100000:1.0:1787823741.921983:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4ea940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+22:2353:x1874668629907584:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787823741.921999:0:14303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823741.922022:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f400/0x5d1142b832482cab lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44bd3 expref: 22 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823741.922042:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e79032ec100) 00010000:00010000:1.0:1787823741.922047:0:14303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823741.922119:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4ea940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+21:2353:x1874668629907584:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 137us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823741.922128:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 1 00000100:00100000:3.0:1787823742.004251:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823742.004578:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629907840 00000100:00100000:2.0:1787823742.004588:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629907840 00000100:00100000:2.0:1787823742.004676:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 34 00000100:00100000:2.0:1787823742.004688:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+21:14474:x1874668629907840:12345-192.168.202.35@tcp:101:dd.0 00010000:00010000:2.0:1787823742.004725:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823742.004804:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482cb9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44bda expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.004941:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2400/0x5d1142b832482cc0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.004955:0:14316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832482c5e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44bb7 expref: 22 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.004963:0:14316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482c73 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44bbe expref: 22 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.004971:0:14316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2400/0x5d1142b832482cc0 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.005006:0:14316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482c73 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44bbe expref: 22 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.005019:0:14316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482c73 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44bbe expref: 22 pid: 14317 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823742.005032:0:14316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a0ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14316:1874668651914496:192.168.202.35@tcp:104: 00010000:00010000:2.0:1787823742.005133:0:14316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832482c5e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44bb7 expref: 22 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.005143:0:14316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832482c5e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44bb7 expref: 22 pid: 15477 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823742.005153:0:14316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a0ecb40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14316:1874668651914624:192.168.202.35@tcp:104: 00000100:00100000:2.0:1787823742.005186:0:14316:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7904944cc0 going to sleep for 11 seconds 00000100:00080000:3.0:1787823742.006278:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787823742.009240:0:14316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a0ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14316:1874668651914496:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787823742.009258:0:14316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a0ecb40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14316:1874668651914624:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787823742.009287:0:14316:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2400/0x5d1142b832482cc0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823742.014546:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823742.014592:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823742.015002:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629907968 00000100:00100000:2.0:1787823742.015013:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629907968 00010000:00010000:2.0:1787823742.015059:0:14301:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482c73 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44bbe expref: 23 pid: 14317 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823742.015100:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629908096 00000100:00100000:2.0:1787823742.015104:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629908096 00010000:00010000:2.0:1787823742.015118:0:14301:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832482c5e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44bb7 expref: 24 pid: 15477 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823742.015134:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 11 00000100:00100000:2.0:1787823742.015142:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793ad52050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+24:2352:x1874668629907968:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787823742.015157:0:14301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787823742.015164:0:14301:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482c73 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44bbe expref: 24 pid: 14317 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.015175:0:14301:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482c73 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44bbe expref: 24 pid: 14317 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.015198:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f600/0x5d1142b832482c73 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44bbe expref: 24 pid: 14317 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.015214:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e79032ec100) 00010000:00010000:2.0:1787823742.015219:0:14301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2400/0x5d1142b832482cc0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.015229:0:14301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2400/0x5d1142b832482cc0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.015308:0:14301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787823742.015370:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793ad52050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+23:2352:x1874668629907968:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 227us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823742.015379:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 11 00000100:00100000:2.0:1787823742.015428:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 12 00000100:00100000:2.0:1787823742.015435:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4ead00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+22:2352:x1874668629908096:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787823742.015444:0:14301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787823742.015449:0:14301:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832482c5e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44bb7 expref: 22 pid: 15477 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.015459:0:14301:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832482c5e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44bb7 expref: 22 pid: 15477 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.015470:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26d000/0x5d1142b832482c5e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44bb7 expref: 22 pid: 15477 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.015483:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e79032ec100) 00010000:00010000:2.0:1787823742.015487:0:14301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2400/0x5d1142b832482cc0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.015495:0:14301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2400/0x5d1142b832482cc0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.015502:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2400/0x5d1142b832482cc0 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.015538:0:14301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787823742.015564:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4ead00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+21:2352:x1874668629908096:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 129us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823742.015571:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 12 00010000:00010000:2.0:1787823742.015593:0:14316:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2400/0x5d1142b832482cc0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.015600:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2400/0x5d1142b832482cc0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787823742.015618:0:14316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787823742.016227:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482cb9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44bda expref: 22 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.016257:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2400/0x5d1142b832482cc0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44bda expref: 21 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.016265:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e79032ec100) 00010000:00010000:2.0:1787823742.016268:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787823742.016270:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d2400, rc 0) 00000100:00100000:2.0:1787823742.016312:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+21:14474:x1874668629907840:12345-192.168.202.35@tcp:101:dd.0 Request processed in 11628us (12081us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1787823742.016320:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 34 00000100:00100000:3.0:1787823742.020882:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823742.021162:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629908352 00000100:00100000:0.0:1787823742.021172:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629908352 00000100:00100000:0.0:1787823742.021244:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 35 00000100:00100000:0.0:1787823742.021255:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+21:14474:x1874668629908352:12345-192.168.202.35@tcp:36:dd.0 00010000:00010000:0.0:1787823742.021536:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ee00/0x5d1142b832482cce lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.021568:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ee00/0x5d1142b832482cce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.021581:0:14317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ee00/0x5d1142b832482cce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787823742.021636:0:14317:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1787823742.021689:0:14317:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd22ea51 reply state 0000000088d93bca transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ee00/0x5d1142b832482cce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823742.021699:0:14317:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787823742.022102:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+24:14474:x1874668629908352:12345-192.168.202.35@tcp:36:dd.0 Request processed in 846us (1230us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1787823742.022111:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 35 00000020:00080000:0.0:1787823742.022116:0:14317:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787823742.026394:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823742.026493:0:15477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629908480 00000100:00100000:0.0:1787823742.026503:0:15477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629908480 00000100:00100000:0.0:1787823742.026573:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 36 00000100:00100000:0.0:1787823742.026582:0:15477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+24:14474:x1874668629908480:12345-192.168.202.35@tcp:101:dd.0 00010000:00010000:0.0:1787823742.026606:0:15477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823742.026628:0:15477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e400/0x5d1142b832482cd5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44be1 expref: -99 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.026703:0:15477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e400/0x5d1142b832482cd5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44be1 expref: 25 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.026719:0:15477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e400/0x5d1142b832482cd5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44be1 expref: 25 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.026888:0:15477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e79032ec100) 00010000:00010000:0.0:1787823742.026892:0:15477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787823742.026896:0:15477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40e400, rc 0) 00000100:00100000:0.0:1787823742.026962:0:15477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+25:14474:x1874668629908480:12345-192.168.202.35@tcp:101:dd.0 Request processed in 380us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823742.026968:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 36 00010000:00010000:2.0:1787823742.031040:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ee00/0x5d1142b832482cce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.031057:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ee00/0x5d1142b832482cce lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.031065:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ee00/0x5d1142b832482cce lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.031094:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40ee00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823742.031099:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ee00/0x5d1142b832482cce lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.031107:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ee00/0x5d1142b832482cce lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.031125:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e79032ec100) 00010000:00010000:2.0:1787823742.031129:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823742.031134:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ee00/0x5d1142b832482cce lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.031141:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ee00/0x5d1142b832482cce lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823742.041500:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823742.041677:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629908736 00000100:00100000:2.0:1787823742.041688:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629908736 00000100:00100000:2.0:1787823742.041801:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 2 00000100:00100000:2.0:1787823742.041812:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ea8de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+24:14474:x1874668629908736:12345-192.168.202.35@tcp:103:dd.0 00010000:00010000:2.0:1787823742.041830:0:14301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787823742.041859:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e400/0x5d1142b832482cd5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44be1 expref: 24 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.041880:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e79032ec100) 00010000:00010000:2.0:1787823742.041885:0:14301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787823742.041942:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ea8de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+23:14474:x1874668629908736:12345-192.168.202.35@tcp:103:dd.0 Request processed in 132us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823742.041950:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 2 00000100:00100000:1.0:1787823742.044133:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823742.044473:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629908864 00000100:00100000:2.0:1787823742.044483:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629908864 00000100:00100000:2.0:1787823742.044543:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 37 00000100:00100000:2.0:1787823742.044553:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+23:14474:x1874668629908864:12345-192.168.202.35@tcp:58:dd.0 00010000:00010000:2.0:1787823742.044664:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482cdc lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.044681:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482cdc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.044692:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482cdc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787823742.045796:0:14318:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787823742.046518:0:14318:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1787823742.046600:0:14318:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1787823742.047095:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+23:14474:x1874668629908864:12345-192.168.202.35@tcp:58:dd.0 Request processed in 2537us (2966us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823742.047107:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 37 00000100:00100000:0.0:1787823742.049701:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823742.049969:0:15477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629908992 00000100:00100000:3.0:1787823742.049979:0:15477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629908992 00000100:00100000:3.0:1787823742.050073:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 38 00000100:00100000:3.0:1787823742.050085:0:15477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7802e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+23:14474:x1874668629908992:12345-192.168.202.35@tcp:101:dd.0 00010000:00010000:3.0:1787823742.050108:0:15477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823742.050129:0:15477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b832482ce3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44be8 expref: -99 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.050207:0:15477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482cdc lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.050219:0:15477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b832482ce3 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44be8 expref: 24 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.050249:0:15477:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482cdc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.050262:0:15477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b832482ce3 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44be8 expref: 24 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.050276:0:15477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e79032ec100) 00010000:00010000:3.0:1787823742.050279:0:15477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787823742.050283:0:15477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b832482ce3 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44be8 expref: 24 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.050291:0:15477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a26c800, rc 0) 00000100:00100000:3.0:1787823742.050350:0:15477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7802e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+24:14474:x1874668629908992:12345-192.168.202.35@tcp:101:dd.0 Request processed in 267us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823742.050358:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 38 00000040:00080000:3.0:1787823742.186391:0:14348:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787823742.186399:0:14348:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787823742.186754:0:14348:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787823742.186781:0:14348:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787823742.186904:0:14348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a4eb840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14348:1874668651914752:192.168.202.35@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787823742.187747:0:14348:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e790afdb540 going to sleep for 11 seconds 00000100:00100000:3.0:1787823742.196168:0:14348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a4eb840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14348:1874668651914752:192.168.202.35@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787823742.206533:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823742.211586:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629909120 00000100:00100000:3.0:1787823742.211605:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629909120 00000100:00100000:3.0:1787823742.212273:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 0 00000100:00100000:3.0:1787823742.212289:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+24:14475:x1874668629909120:12345-192.168.202.35@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787823742.212387:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+24:14475:x1874668629909120:12345-192.168.202.35@tcp:900:lhsmtool_posix.0 Request processed in 102us (5863us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823742.212395:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 0 00000100:00100000:0.0:1787823742.222627:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823742.223909:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629909248 00000100:00100000:2.0:1787823742.223923:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629909248 00000100:00100000:2.0:1787823742.223980:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 39 00000100:00100000:2.0:1787823742.223991:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7802e10b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+24:14475:x1874668629909248:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787823742.224027:0:14317:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787823742.224384:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7802e10b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+24:14475:x1874668629909248:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 Request processed in 394us (1765us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823742.224393:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 39 00000100:00100000:0.0:1787823742.240962:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823742.241868:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629909376 00000100:00100000:2.0:1787823742.241880:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629909376 00000100:00100000:2.0:1787823742.241955:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 40 00000100:00100000:2.0:1787823742.241964:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7802e11680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+24:14475:x1874668629909376:12345-192.168.202.35@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787823742.242031:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832482cea lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.242047:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832482cea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.242060:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832482cea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.242075:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832482cf1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.242083:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832482cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.242089:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832482cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.242108:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3e00/0x5d1142b832482cf8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.242115:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3e00/0x5d1142b832482cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.242121:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3e00/0x5d1142b832482cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787823742.242156:0:14316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787823742.242160:0:14316:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787823742.242172:0:14316:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3e00/0x5d1142b832482cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.242188:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832482cea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.242195:0:14316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832482cea lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.242203:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832482cea lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.242209:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d2c00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823742.242213:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832482cea lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.242221:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832482cea lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.242391:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e79228da200) 00010000:00010000:2.0:1787823742.242395:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823742.242401:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832482cea lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.242408:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832482cea lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.242421:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832482cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.242436:0:14316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832482cf1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.242442:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832482cf1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.242453:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d2a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823742.242456:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832482cf1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.242462:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832482cf1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.242470:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8e79228dab00) 00010000:00010000:2.0:1787823742.242473:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823742.242476:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832482cf1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.242482:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832482cf1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.242496:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3e00/0x5d1142b832482cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.242501:0:14316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3e00/0x5d1142b832482cf8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.242515:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3e00/0x5d1142b832482cf8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.242520:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3e00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823742.242523:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3e00/0x5d1142b832482cf8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.242528:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3e00/0x5d1142b832482cf8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.242546:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e79032ec100) 00010000:00010000:2.0:1787823742.242548:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823742.242551:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3e00/0x5d1142b832482cf8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.242557:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3e00/0x5d1142b832482cf8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823742.242640:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7802e11680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+24:14475:x1874668629909376:12345-192.168.202.35@tcp:34:lhsmtool_posix.0 Request processed in 675us (1687us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823742.242656:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 40 00000100:00100000:1.0:1787823742.246027:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823742.246898:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629909632 00000100:00100000:0.0:1787823742.246910:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629909632 00000100:00100000:0.0:1787823742.246978:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 41 00000100:00100000:0.0:1787823742.246989:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+24:14475:x1874668629909632:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787823742.247014:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823742.247038:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f400/0x5d1142b832482cff lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44bef expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.247161:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832482d06 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.247178:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832482d06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.247191:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832482d06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787823742.247202:0:14318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787823742.247420:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832482d06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.247429:0:14318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832482d06 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.247436:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832482d06 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.247443:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40f800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1787823742.247447:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832482d06 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.247454:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832482d06 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.247468:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e79032ec100) 00010000:00010000:0.0:1787823742.247471:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787823742.247476:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832482d06 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.247482:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832482d06 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.247541:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f400/0x5d1142b832482cff lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44bef expref: 26 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.247552:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e79228da200) 00010000:00010000:0.0:1787823742.247554:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787823742.247558:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f400/0x5d1142b832482cff lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44bef expref: 26 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.247578:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40f400, rc 0) 00000100:00100000:0.0:1787823742.247696:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+25:14475:x1874668629909632:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 707us (1677us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1787823742.247704:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 41 00000100:00100000:0.0:1787823742.265410:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823742.265662:0:15477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629909760 00000100:00100000:3.0:1787823742.265672:0:15477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629909760 00000100:00100000:3.0:1787823742.265731:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 42 00000100:00100000:3.0:1787823742.265741:0:15477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7802e13840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+25:14475:x1874668629909760:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787823742.265807:0:15477:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787823742.265932:0:15477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7802e13840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+25:14475:x1874668629909760:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 Request processed in 191us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823742.265940:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 42 00000100:00100000:1.0:1787823742.274334:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823742.274479:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629910016 00000100:00100000:2.0:1787823742.274490:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629910016 00000100:00100000:2.0:1787823742.274563:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 43 00000100:00100000:2.0:1787823742.274573:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+25:14475:x1874668629910016:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787823742.274595:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823742.274616:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3e00/0x5d1142b832482d14 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44bf6 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787823742.275316:0:14317:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:2.0:1787823742.275324:0:14317:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1787823742.275384:0:14317:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1787823742.275643:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832482d1b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.275657:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832482d1b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.275668:0:14317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832482d1b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.275735:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3e00/0x5d1142b832482d14 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44bf6 expref: 28 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.275753:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832482d1b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44bf6 expref: 27 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.275807:0:14317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e79228dab00) 00010000:00010000:2.0:1787823742.275810:0:14317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787823742.275813:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d2a00, rc 0) 00000100:00100000:2.0:1787823742.275884:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+27:14475:x1874668629910016:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 1312us (1563us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1787823742.275893:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 43 00000100:00100000:1.0:1787823742.281744:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823742.281944:0:15477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629910272 00000100:00100000:3.0:1787823742.281954:0:15477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629910272 00000100:00100000:3.0:1787823742.282012:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 44 00000100:00100000:3.0:1787823742.282024:0:15477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+27:14475:x1874668629910272:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787823742.282097:0:15477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787823742.282129:0:15477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2a00/0x5d1142b832482d1b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44bf6 expref: 27 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.282147:0:15477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e79228dab00) 00010000:00010000:3.0:1787823742.282173:0:15477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787823742.282197:0:15477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482d29 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.282212:0:15477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482d29 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.282222:0:15477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482d29 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.282248:0:15477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482d30 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe6a115ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.282255:0:15477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482d30 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe6a115ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.282262:0:15477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482d30 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe6a115ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.282343:0:15477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482d29 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.282351:0:15477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482d29 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.282358:0:15477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482d29 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.282364:0:15477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26ce00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823742.282368:0:15477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482d29 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.282376:0:15477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482d29 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.282393:0:15477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e79032ec800) 00010000:00010000:3.0:1787823742.282395:0:15477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787823742.282399:0:15477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482d29 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.282405:0:15477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482d29 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.282415:0:15477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482d30 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe6a115ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.282421:0:15477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482d30 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe6a115ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.282593:0:15477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482d30 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe6a115ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.282598:0:15477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26de00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823742.282601:0:15477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482d30 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe6a115ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.282607:0:15477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482d30 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe6a115ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.282616:0:15477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xe6a115ce (ffff8e79032ec600) 00010000:00010000:3.0:1787823742.282619:0:15477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787823742.282622:0:15477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482d30 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe6a115ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.282627:0:15477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482d30 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe6a115ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823742.282851:0:15477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+26:14475:x1874668629910272:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 Request processed in 826us (1115us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787823742.282858:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 44 00000100:00100000:3.0:1787823742.285918:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823742.286182:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629910400 00000100:00100000:2.0:1787823742.286191:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629910400 00000100:00100000:2.0:1787823742.286241:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 45 00000100:00100000:2.0:1787823742.286250:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+26:14475:x1874668629910400:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787823742.286271:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823742.286292:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832482d37 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44bfd expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.286327:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482d3e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.286340:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482d3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.286352:0:14317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482d3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.286741:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832482d37 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44bfd expref: 28 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.286792:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2800/0x5d1142b832482d3e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44bfd expref: 27 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.286801:0:14317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e79228da600) 00010000:00010000:2.0:1787823742.286804:0:14317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787823742.286807:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d2800, rc 0) 00000100:00100000:2.0:1787823742.286874:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+27:14475:x1874668629910400:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 625us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823742.286881:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 45 00000100:00100000:1.0:1787823742.293860:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823742.294027:0:15477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629910656 00000100:00100000:3.0:1787823742.294038:0:15477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629910656 00000100:00100000:3.0:1787823742.294103:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 46 00000100:00100000:3.0:1787823742.294113:0:15477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+27:14475:x1874668629910656:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787823742.294205:0:15477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482d45 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.294222:0:15477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482d45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.294234:0:15477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482d45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787823742.294872:0:15477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1787823742.294882:0:15477:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 483149123243ns, next at 484149121236ns, rc = 0 00000004:00010000:3.0:1787823742.294967:0:15477:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c7145cd reply state 0000000008fd9115 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482d45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823742.294976:0:15477:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787823742.295101:0:15477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+29:14475:x1874668629910656:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 Request processed in 987us (1252us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1787823742.295109:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 46 00010000:00010000:2.0:1787823742.297463:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482d45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.297481:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482d45 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.297489:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482d45 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.297496:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26de00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823742.297501:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482d45 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.297520:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482d45 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.297538:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e79228da600) 00010000:00010000:2.0:1787823742.297558:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787823742.297564:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482d45 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.297570:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26de00/0x5d1142b832482d45 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823742.300626:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823742.305603:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629910784 00000100:00100000:0.0:1787823742.305621:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629910784 00000100:00100000:0.0:1787823742.305710:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 47 00000100:00100000:0.0:1787823742.305721:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+28:14475:x1874668629910784:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787823742.305748:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787823742.305791:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832482d4c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44c04 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.305857:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832482d4c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44c04 expref: 29 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.305873:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832482d4c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44c04 expref: 29 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.305892:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e79228da600) 00010000:00010000:0.0:1787823742.305895:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787823742.305899:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a40f800, rc 0) 00000100:00100000:0.0:1787823742.306113:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+29:14475:x1874668629910784:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 392us (5497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823742.306121:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 47 00000100:00100000:1.0:1787823742.308532:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823742.308666:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629910912 00000100:00100000:3.0:1787823742.308687:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629910912 00000100:00100000:3.0:1787823742.308786:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 12 00000100:00100000:3.0:1787823742.308797:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7922a0cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+5:2353:x1874668629910912:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1787823742.309043:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787823742.309266:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7922a0cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+6:2353:x1874668629910912:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 Request processed in 470us (739us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787823742.309274:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 12 00000100:00100000:3.0:1787823742.312024:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823742.312366:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629911168 00000100:00100000:0.0:1787823742.312376:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629911168 00000100:00100000:0.0:1787823742.312554:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00100000:0.0:1787823742.312566:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+29:14475:x1874668629911168:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787823742.312849:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+30:14475:x1874668629911168:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 Request processed in 284us (910us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1787823742.312858:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00100000:1.0:1787823742.322883:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823742.322983:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629911424 00000100:00100000:2.0:1787823742.322994:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629911424 00000100:00100000:2.0:1787823742.323058:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 48 00000100:00100000:2.0:1787823742.323068:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a03da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+30:14475:x1874668629911424:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787823742.323190:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a03da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+30:14475:x1874668629911424:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 Request processed in 124us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823742.323198:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 48 00000100:00100000:3.0:1787823742.331182:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823742.331337:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629911552 00000100:00100000:2.0:1787823742.331346:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629911552 00000100:00100000:2.0:1787823742.331401:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 49 00000100:00100000:2.0:1787823742.331411:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a4e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+30:14475:x1874668629911552:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787823742.331438:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823742.331461:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832482d53 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44c0b expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.331561:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3e00/0x5d1142b832482d5a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.331578:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3e00/0x5d1142b832482d5a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.331590:0:14317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3e00/0x5d1142b832482d5a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787823742.331634:0:14317:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787823742.331663:0:14317:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3e00/0x5d1142b832482d5a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.331689:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d2c00/0x5d1142b832482d53 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44c0b expref: 32 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.331707:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3e00/0x5d1142b832482d5a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44c0b expref: 31 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.331715:0:14317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e79228da600) 00010000:00010000:2.0:1787823742.331718:0:14317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787823742.331721:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d3e00, rc 0) 00000100:00100000:2.0:1787823742.331824:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a4e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+31:14475:x1874668629911552:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 413us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823742.331831:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 49 00000100:00100000:0.0:1787823742.337404:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823742.337492:0:16538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629911680 00000100:00100000:2.0:1787823742.337510:0:16538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629911680 00000100:00100000:2.0:1787823742.337582:0:16538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 13 00000100:00100000:2.0:1787823742.337595:0:16538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7802e12580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+6:2355:x1874668629911680:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787823742.337622:0:16538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787823742.337646:0:16538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832482d61 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44c12 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787823742.337705:0:16538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a90067e, blocks: 0x1 00010000:00010000:2.0:1787823742.337729:0:16538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=483s v=(0 0) 00010000:00010000:2.0:1787823742.337785:0:16538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823742.337797:0:16538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832482d61 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44c12 expref: 7 pid: 16538 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.337821:0:16538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832482d61 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44c12 expref: 7 pid: 16538 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.337835:0:16538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e79358d2c00, rc 0) 00000100:00100000:2.0:1787823742.337896:0:16538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7802e12580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+7:2355:x1874668629911680:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 304us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823742.337904:0:16538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 13 00000100:00100000:1.0:1787823742.340868:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823742.341094:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629911936 00000100:00100000:2.0:1787823742.341103:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629911936 00000100:00100000:2.0:1787823742.341158:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 50 00000100:00100000:2.0:1787823742.341167:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a03ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+31:14475:x1874668629911936:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787823742.341811:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a03ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+31:14475:x1874668629911936:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 Request processed in 640us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823742.341820:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 50 00000100:00100000:3.0:1787823742.346927:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823742.347297:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629912064 00000100:00100000:2.0:1787823742.347308:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629912064 00000100:00100000:2.0:1787823742.347362:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 51 00000100:00100000:2.0:1787823742.347372:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+31:14475:x1874668629912064:12345-192.168.202.35@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787823742.419306:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:1.0:1787823742.419333:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:1.0:1787823742.419344:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000004:00080000:1.0:1787823742.419371:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1787823742.419556:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787823742.419576:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651914880:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787823742.419659:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823742.420009:0:16261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651914880 00000100:00100000:3.0:1787823742.420017:0:16261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651914880 00000100:00080000:1.0:1787823742.420213:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787823742.420271:0:16261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787823742.420282:0:16261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874668651914880:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787823742.420563:0:16261:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787823742.420567:0:16261:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1787823742.420570:0:16261:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787823742.420572:0:16261:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787823742 -> 1787823742 00002000:00010000:3.0:1787823742.420575:0:16261:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787823742.420641:0:16261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1874668651914880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 360us (991us total) trans 8589934595 rc 0/0 00000004:00080000:1.0:1787823742.420865:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e792ec4d680/2, rc 0, transno 8589934595 00000100:00100000:1.0:1787823742.420872:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874668651914880:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787823742.420939:0:16261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787823742.424382:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+14:14475:x1874668629912064:12345-192.168.202.35@tcp:44:lhsmtool_posix.0 Request processed in 77000us (77458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823742.424396:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 51 00000100:00100000:0.0:1787823742.426728:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823742.426936:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629912192 00000100:00100000:2.0:1787823742.426956:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629912192 00000100:00100000:2.0:1787823742.427017:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 15 00000100:00100000:2.0:1787823742.427028:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7802e11a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+7:2353:x1874668629912192:12345-192.168.202.35@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787823742.427152:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7802e11a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+7:2353:x1874668629912192:12345-192.168.202.35@tcp:16:lhsmtool_posix.0 Request processed in 125us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823742.427161:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 15 00000100:00100000:1.0:1787823742.434101:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823742.435684:0:15477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629912448 00000100:00100000:3.0:1787823742.435818:0:15477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629912448 00000100:00100000:3.0:1787823742.435941:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 52 00000100:00100000:3.0:1787823742.435967:0:15477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a03e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+14:14475:x1874668629912448:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787823742.436027:0:15477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787823742.436054:0:15477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3e00/0x5d1142b832482d5a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44c0b expref: 14 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.436073:0:15477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e79228da600) 00010000:00010000:3.0:1787823742.436078:0:15477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787823742.436108:0:15477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482d68 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.436121:0:15477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482d68 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.436131:0:15477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482d68 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787823742.436341:0:15477:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a35aa0fb reply state 000000002b9113c5 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482d68 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823742.436351:0:15477:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787823742.436470:0:15477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a03e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+15:14475:x1874668629912448:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 Request processed in 504us (2377us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1787823742.436478:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 52 00010000:00010000:2.0:1787823742.440056:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482d68 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.440074:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482d68 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.440083:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482d68 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.440089:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26ce00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823742.440094:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482d68 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.440102:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482d68 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.440120:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e79228da600) 00010000:00010000:2.0:1787823742.440123:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823742.440128:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482d68 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.440135:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26ce00/0x5d1142b832482d68 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15477 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823742.449069:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823742.449156:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629912576 00000100:00100000:3.0:1787823742.449167:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629912576 00000100:00100000:3.0:1787823742.449293:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 16 00000100:00100000:3.0:1787823742.449304:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a03f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+7:14475:x1874668629912576:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787823742.449323:0:15001:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787823742.449345:0:15001:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b1de29d/0x5d1142b832482d6f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfe697ab316f44c19 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.449401:0:15001:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832482d61 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44c12 expref: 8 pid: 16538 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.449412:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787823742.449417:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787823742.449422:0:15001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b1de29d/0x5d1142b832482d6f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44c19 expref: 8 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.449460:0:15001:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832482d61 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44c12 expref: 8 pid: 16538 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.449475:0:15001:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832482d61 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44c12 expref: 8 pid: 16538 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823742.449489:0:15001:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec4c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15001:1874668651915008:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787823742.449738:0:15001:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7902a8ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787823742.456999:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823742.457035:0:15001:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec4c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15001:1874668651915008:192.168.202.35@tcp:104: 00010000:00010000:2.0:1787823742.457072:0:15001:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004b1de29d/0x5d1142b832482d6f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44c19 expref: 8 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.457097:0:15001:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e793a26ce00, rc 0) 00000100:00100000:0.0:1787823742.457188:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629912704 00000100:00100000:0.0:1787823742.457195:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629912704 00010000:00010000:0.0:1787823742.457232:0:14302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832482d61 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44c12 expref: 9 pid: 16538 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823742.457275:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 13 00000100:00100000:0.0:1787823742.457284:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a03e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+9:2352:x1874668629912704:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787823742.457298:0:14302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787823742.457319:0:14302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832482d61 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44c12 expref: 9 pid: 16538 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.457331:0:14302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832482d61 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44c12 expref: 9 pid: 16538 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.457353:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f22558c3/0x5d1142b832482d61 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44c12 expref: 9 pid: 16538 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.457385:0:14302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787823742.457390:0:14302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787823742.457396:0:14302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004b1de29d/0x5d1142b832482d6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44c19 expref: 8 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.457407:0:14302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b1de29d/0x5d1142b832482d6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44c19 expref: 8 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.457441:0:14302:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004b1de29d/0x5d1142b832482d6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44c19 expref: 8 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823742.457455:0:14302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7920d63c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14302:1874668651915136:192.168.202.35@tcp:105: 00000100:00100000:0.0:1787823742.457538:0:14302:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7902a93b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787823742.458354:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a03f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+8:14475:x1874668629912576:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 9046us (9293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823742.458364:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 16 00000100:00100000:0.0:1787823742.462999:0:14302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7920d63c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14302:1874668651915136:192.168.202.35@tcp:105: 00010000:00010000:0.0:1787823742.463027:0:14302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787823742.463095:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a03e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+7:2352:x1874668629912704:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 5810us (6105us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823742.463106:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 13 00000100:00100000:3.0:1787823742.464015:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823742.464098:0:16261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629912832 00000100:00100000:2.0:1787823742.464106:0:16261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629912832 00000100:00100000:2.0:1787823742.464165:0:16261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 17 00000100:00100000:2.0:1787823742.464174:0:16261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+7:2352:x1874668629912832:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787823742.464384:0:16261:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787823742.464388:0:16261:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787823742 00002000:00010000:2.0:1787823742.464391:0:16261:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787823741 00002000:00010000:2.0:1787823742.464393:0:16261:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787823742 -> 1787823742 00002000:00010000:2.0:1787823742.464396:0:16261:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787823742.464453:0:16261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+8:2352:x1874668629912832:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 Request processed in 279us (442us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787823742.464460:0:16261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 17 00000100:00100000:1.0:1787823742.469683:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823742.469808:0:16538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629912960 00000100:00100000:0.0:1787823742.469819:0:16538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629912960 00000100:00100000:0.0:1787823742.469866:0:16538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 18 00000100:00100000:0.0:1787823742.469874:0:16538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a03d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+8:2352:x1874668629912960:12345-192.168.202.35@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787823742.469915:0:16538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000455794f8/0x5d1142b832482d76 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.469946:0:16538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004b1de29d/0x5d1142b832482d6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44c19 expref: 8 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.469955:0:16538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787823742.469959:0:16538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787823742.469964:0:16538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000455794f8/0x5d1142b832482d76 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.469996:0:16538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004b1de29d/0x5d1142b832482d6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44c19 expref: 8 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.470011:0:16538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004b1de29d/0x5d1142b832482d6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44c19 expref: 8 pid: 15001 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823742.470025:0:16538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7920d63c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16538:1874668651915264:192.168.202.35@tcp:104: 00000100:00100000:0.0:1787823742.470103:0:16538:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7902a93b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787823742.475068:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823742.475144:0:16538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7920d63c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16538:1874668651915264:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787823742.475170:0:16538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000455794f8/0x5d1142b832482d76 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823742.476133:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629913088 00000100:00100000:2.0:1787823742.476141:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629913088 00010000:00010000:2.0:1787823742.476192:0:14303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004b1de29d/0x5d1142b832482d6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44c19 expref: 9 pid: 15001 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823742.476241:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 14 00000100:00100000:2.0:1787823742.476251:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+9:2352:x1874668629913088:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787823742.476284:0:14303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787823742.476306:0:14303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004b1de29d/0x5d1142b832482d6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44c19 expref: 9 pid: 15001 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.476319:0:14303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004b1de29d/0x5d1142b832482d6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44c19 expref: 9 pid: 15001 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.476342:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b1de29d/0x5d1142b832482d6f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44c19 expref: 9 pid: 15001 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.476358:0:14303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787823742.476362:0:14303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787823742.476368:0:14303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000455794f8/0x5d1142b832482d76 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.476378:0:14303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000455794f8/0x5d1142b832482d76 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.476400:0:14303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787823742.476490:0:16538:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000455794f8/0x5d1142b832482d76 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.476500:0:16538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000455794f8/0x5d1142b832482d76 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.476542:0:16538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000455794f8/0x5d1142b832482d76 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.476550:0:16538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000455794f8/0x5d1142b832482d76 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.476557:0:16538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000455794f8/0x5d1142b832482d76 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.476564:0:16538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40f600 already unused, calling callback (ffffffffc1649440) 00010000:00010000:0.0:1787823742.476568:0:16538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000455794f8/0x5d1142b832482d76 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.476576:0:16538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000455794f8/0x5d1142b832482d76 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.476587:0:16538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000455794f8/0x5d1142b832482d76 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.476604:0:16538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000455794f8/0x5d1142b832482d76 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823742.477489:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+8:2352:x1874668629913088:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 1232us (2427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823742.477500:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 14 00000100:00100000:0.0:1787823742.477730:0:16538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a03d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+7:2352:x1874668629912960:12345-192.168.202.35@tcp:1:lhsmtool_posix.0 Request processed in 7854us (8054us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823742.477752:0:16538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 18 00000100:00100000:3.0:1787823742.491104:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823742.492209:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629913344 00000100:00100000:0.0:1787823742.492223:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629913344 00000100:00100000:0.0:1787823742.492299:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 53 00000100:00100000:0.0:1787823742.492311:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+14:14475:x1874668629913344:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787823742.492394:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e400/0x5d1142b832482d7d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.492413:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e400/0x5d1142b832482d7d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.492424:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e400/0x5d1142b832482d7d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.492708:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ee00/0x5d1142b832482d84 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.492720:0:14318:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832482d4c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44c04 expref: 15 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.492729:0:14318:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ee00/0x5d1142b832482d84 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.492794:0:14318:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832482d4c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44c04 expref: 15 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.492809:0:14318:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832482d4c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44c04 expref: 15 pid: 14318 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823742.492837:0:14318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e7920d63c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14318:1874668651915392:192.168.202.35@tcp:104: 00000100:00100000:0.0:1787823742.492932:0:14318:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7902a93b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787823742.495155:0:14318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e7920d63c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14318:1874668651915392:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787823742.495182:0:14318:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ee00/0x5d1142b832482d84 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823742.496286:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823742.501452:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629913472 00000100:00100000:0.0:1787823742.501468:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629913472 00010000:00010000:1.0:1787823742.502367:0:14302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832482d4c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44c04 expref: 16 pid: 14318 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823742.502434:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 15 00000100:00100000:1.0:1787823742.502445:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a03de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+16:2352:x1874668629913472:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787823742.502461:0:14302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787823742.502468:0:14302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832482d4c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44c04 expref: 16 pid: 14318 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823742.502481:0:14302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832482d4c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44c04 expref: 16 pid: 14318 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823742.502515:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40f800/0x5d1142b832482d4c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44c04 expref: 16 pid: 14318 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823742.502535:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e79228da600) 00010000:00010000:1.0:1787823742.502541:0:14302:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ee00/0x5d1142b832482d84 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823742.502550:0:14302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ee00/0x5d1142b832482d84 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823742.504977:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ee00/0x5d1142b832482d84 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823742.505307:0:14302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787823742.505383:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a03de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+15:2352:x1874668629913472:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 2936us (9098us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823742.505394:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 15 00010000:00010000:0.0:1787823742.513688:0:14318:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ee00/0x5d1142b832482d84 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.513713:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ee00/0x5d1142b832482d84 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787823742.514017:0:14318:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1787823742.514197:0:14318:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1787823742.514242:0:14318:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1787823742.514328:0:14318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a03d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14318:1874668651915520:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787823742.514437:0:14318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823742.514475:0:14318:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e793a47ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1787823742.516867:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651915520 00000100:00100000:2.0:1787823742.516882:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651915520 00000100:00100000:2.0:1787823742.516947:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787823742.516961:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a03c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14318:x1874668651915520:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787823742.517107:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a03c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14318:x1874668651915520:12345-0@lo:1000:mdt00_002.0 Request processed in 149us (2669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823742.517115:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787823742.517249:0:14318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a03d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14318:1874668651915520:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1787823742.518002:0:14318:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1787823742.518087:0:14318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e792ec4cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14318:1874668651915648:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787823742.518131:0:14318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787823742.518163:0:14318:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e7909b75180 going to sleep for 11 seconds 00000100:00100000:2.0:1787823742.518307:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651915648 00000100:00100000:2.0:1787823742.518313:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651915648 00000100:00100000:2.0:1787823742.518352:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787823742.518360:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14318:x1874668651915648:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787823742.518526:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14318:x1874668651915648:12345-0@lo:1000:mdt00_002.0 Request processed in 166us (394us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787823742.518533:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787823742.518635:0:14318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e792ec4cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14318:1874668651915648:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1787823742.518725:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ee00/0x5d1142b832482d84 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.518735:0:14318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ee00/0x5d1142b832482d84 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.518742:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ee00/0x5d1142b832482d84 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.518747:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40ee00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823742.518751:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ee00/0x5d1142b832482d84 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.518892:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ee00/0x5d1142b832482d84 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.518912:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e79228da600) 00010000:00010000:3.0:1787823742.518915:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787823742.518919:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ee00/0x5d1142b832482d84 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.518925:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40ee00/0x5d1142b832482d84 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.518954:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482cdc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.518961:0:14318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482cdc lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.518975:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482cdc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.518980:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1787823742.518983:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482cdc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.518990:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482cdc lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.518998:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e79032ec100) 00010000:00010000:3.0:1787823742.519001:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787823742.519008:0:14318:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b832482ce3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44be8 expref: 18 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.519019:0:14318:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b832482ce3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44be8 expref: 18 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.519028:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b832482ce3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44be8 expref: 18 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.519278:0:14318:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a26c800/0x5d1142b832482ce3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0xfe697ab316f44be8 expref: 18 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823742.519293:0:14318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a0ec780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14318:1874668651915776:192.168.202.35@tcp:105: 00000100:00100000:2.0:1787823742.519366:0:14318:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e79189a2180 going to sleep for 11 seconds 00000100:00100000:0.0:1787823742.523268:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823742.523335:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629913600 00000100:00100000:1.0:1787823742.523343:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629913600 00000100:00100000:1.0:1787823742.523398:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 10 00000100:00100000:1.0:1787823742.523407:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e78011f7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+19:14474:x1874668629913600:12345-192.168.202.35@tcp:49:dd.0 00000100:00100000:1.0:1787823742.523559:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e78011f7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+19:14474:x1874668629913600:12345-192.168.202.35@tcp:49:dd.0 Request processed in 152us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823742.523566:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 10 00000100:00100000:2.0:1787823742.527888:0:14318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a0ec780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14318:1874668651915776:192.168.202.35@tcp:105: 00010000:00010000:2.0:1787823742.527924:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482cdc lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.527934:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3800/0x5d1142b832482cdc lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.527973:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3c00/0x5d1142b832482d8b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.527986:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3c00/0x5d1142b832482d8b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.528015:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3c00/0x5d1142b832482d8b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.528026:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3c00/0x5d1142b832482d8b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.528032:0:14318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3c00/0x5d1142b832482d8b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.528038:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3c00/0x5d1142b832482d8b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.528043:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3c00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823742.528046:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3c00/0x5d1142b832482d8b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.528053:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3c00/0x5d1142b832482d8b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.528066:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e79032ec100) 00010000:00010000:2.0:1787823742.528068:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787823742.528072:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3c00/0x5d1142b832482d8b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.528077:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e79358d3c00/0x5d1142b832482d8b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.528085:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e400/0x5d1142b832482d7d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.528090:0:14318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e400/0x5d1142b832482d7d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.528101:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e400/0x5d1142b832482d7d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.528106:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40e400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1787823742.528108:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e400/0x5d1142b832482d7d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.528114:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e400/0x5d1142b832482d7d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.528121:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e79032ec100) 00010000:00010000:2.0:1787823742.528123:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787823742.528125:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e400/0x5d1142b832482d7d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.528130:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e793a40e400/0x5d1142b832482d7d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823742.529000:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+18:14475:x1874668629913344:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 Request processed in 36686us (38457us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1787823742.529013:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 53 00000020:00080000:2.0:1787823742.529018:0:14318:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1787823742.532827:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823742.532981:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629913856 00000100:00100000:1.0:1787823742.532990:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629913856 00000100:00100000:1.0:1787823742.533047:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 11 00000100:00100000:1.0:1787823742.533056:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7920d63c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+18:14475:x1874668629913856:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 00000040:00080000:3.0:1787823742.533734:0:14348:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787823742.533740:0:14348:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787823742.533941:0:14348:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787823742.533947:0:14348:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000004:00080000:1.0:1787823742.535028:0:14319:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787823742.535146:0:14319:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1787823742.535199:0:14319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482d92 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823742.535215:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482d92 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823742.536362:0:14319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482d92 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823742.536376:0:14319:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482d92 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823742.536397:0:14319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482d92 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823742.536402:0:14319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482d92 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823742.536604:0:14319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787823742.536742:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7920d63c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+20:14475:x1874668629913856:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 Request processed in 3682us (3921us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1787823742.536752:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 11 00000020:00080000:1.0:1787823742.536787:0:14319:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787823742.538984:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787823742.538999:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482d92 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.539030:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eeaa00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:3.0:1787823742.539034:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482d92 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.539044:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482d92 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.539062:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e79228da600) 00010000:00010000:3.0:1787823742.539065:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787823742.539071:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482d92 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.539077:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7920eeaa00/0x5d1142b832482d92 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.539299:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823742.539302:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787823742.539303:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787823742.708867:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823742.708914:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823742.708949:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823742.709059:0:15005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629913984 00000100:00100000:0.0:1787823742.709073:0:15005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629913984 00000100:00100000:0.0:1787823742.709127:0:15005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629914112 00000100:00100000:0.0:1787823742.709130:0:15005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629914112 00000100:00100000:0.0:1787823742.709148:0:15005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629914240 00000100:00100000:0.0:1787823742.709152:0:15005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629914240 00000100:00100000:0.0:1787823742.709168:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 0 00000100:00100000:0.0:1787823742.709178:0:15005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a03f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+9:2353:x1874668629913984:12345-192.168.202.35@tcp:4:dd.0 00002000:00010000:0.0:1787823742.709244:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a90067e, atime: 0x6a90067d, ctime: 0x6a90067e, blocks: 0x1 00010000:00010000:0.0:1787823742.709255:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000455794f8/0x5d1142b832482d99 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.709288:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1787823742.709293:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787823742.709300:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000455794f8/0x5d1142b832482d99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.709313:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000455794f8/0x5d1142b832482d99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823742.718131:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823742.718169:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823742.718207:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823742.718298:0:15006:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787823742.718309:0:15006:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1787823742.718602:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629914368 00000100:00100000:2.0:1787823742.718625:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629914368 00000100:00100000:0.0:1787823742.720218:0:16541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629914496 00000100:00100000:2.0:1787823742.720370:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629914624 00000100:00100000:2.0:1787823742.720382:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629914624 00000100:00100000:2.0:1787823742.720419:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 1 00000100:00100000:2.0:1787823742.720428:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a03c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+12:2352:x1874668629914112:12345-192.168.202.35@tcp:4:dd.0 00010000:00010000:2.0:1787823742.720465:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b832482da0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.720484:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823742.720489:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823742.720496:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b832482da0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.720529:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b832482da0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823742.720988:0:16541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629914496 00000100:00100000:0.0:1787823742.726386:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823742.726533:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787823742.726576:0:16541:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1787823742.726585:0:16541:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:1.0:1787823742.727471:0:16541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629914752 00000100:00100000:1.0:1787823742.727482:0:16541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629914752 00000100:00100000:1.0:1787823742.727545:0:16541:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1787823742.727553:0:16541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629914880 00000100:00100000:1.0:1787823742.727556:0:16541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629914880 00000100:00100000:1.0:1787823742.728537:0:16542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 2 00000100:00100000:1.0:1787823742.728553:0:16542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a03fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+15:2353:x1874668629914240:12345-192.168.202.35@tcp:4:dd.0 00010000:00010000:1.0:1787823742.728591:0:16542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083e5076a/0x5d1142b832482da7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823742.728609:0:16542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787823742.728619:0:16542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787823742.728628:0:16542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083e5076a/0x5d1142b832482da7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823742.728642:0:16542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083e5076a/0x5d1142b832482da7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787823742.825971:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:3.0:1787823742.825995:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:3.0:1787823742.826018:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:3.0:1787823742.826089:0:15005:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:3.0:1787823742.826094:0:15005:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787823742 -> 1787823743 00002000:00010000:3.0:1787823742.826096:0:15005:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787823742 -> 1787823743 00002000:00010000:3.0:1787823742.826098:0:15005:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 6151 00010000:00010000:3.0:1787823742.826115:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000455794f8/0x5d1142b832482d99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.826129:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000455794f8/0x5d1142b832482d99 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.826139:0:15005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000455794f8/0x5d1142b832482d99 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.826162:0:15005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40f600 already unused, calling callback (ffffffffc1649440) 00010000:00010000:3.0:1787823742.826167:0:15005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000455794f8/0x5d1142b832482d99 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.826177:0:15005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000455794f8/0x5d1142b832482d99 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.826201:0:15005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000455794f8/0x5d1142b832482d99 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.826210:0:15005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000455794f8/0x5d1142b832482d99 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823742.826441:0:15005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a03f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+14:2353:x1874668629913984:12345-192.168.202.35@tcp:4:dd.0 Request processed in 117259us (117583us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1787823742.826454:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 0 00000100:00100000:3.0:1787823742.826487:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 3 00000100:00100000:3.0:1787823742.826516:0:15005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+13:2353:x1874668629914368:12345-192.168.202.35@tcp:4:dd.0 00010000:00010000:3.0:1787823742.826559:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbb49a0d/0x5d1142b832482dae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.826574:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787823742.826579:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787823742.826597:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fbb49a0d/0x5d1142b832482dae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.826622:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fbb49a0d/0x5d1142b832482dae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.827161:0:16542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083e5076a/0x5d1142b832482da7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823742.827649:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787823742.828249:0:16542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083e5076a/0x5d1142b832482da7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.828261:0:16542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083e5076a/0x5d1142b832482da7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.828553:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b832482da0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.828562:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b832482da0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.828569:0:15006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b832482da0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.828575:0:15006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3c00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:0.0:1787823742.828579:0:15006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b832482da0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.828587:0:15006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b832482da0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.828628:0:15006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b832482da0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.828636:0:15006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d6de362/0x5d1142b832482da0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823742.828720:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a03c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+13:2352:x1874668629914112:12345-192.168.202.35@tcp:4:dd.0 Request processed in 108289us (119801us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1787823742.828731:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 1 00000100:00100000:0.0:1787823742.828785:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 4 00000100:00100000:0.0:1787823742.828797:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+12:2352:x1874668629914624:12345-192.168.202.35@tcp:4:dd.0 00010000:00010000:0.0:1787823742.828828:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d741ea82/0x5d1142b832482db5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.828840:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787823742.828844:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787823742.828850:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d741ea82/0x5d1142b832482db5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.828861:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d741ea82/0x5d1142b832482db5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.833999:0:16542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7920eeb600 already unused, calling callback (ffffffffc1649440) 00010000:00010000:3.0:1787823742.834015:0:16542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083e5076a/0x5d1142b832482da7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.834037:0:16542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083e5076a/0x5d1142b832482da7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.834062:0:16542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083e5076a/0x5d1142b832482da7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.834070:0:16542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083e5076a/0x5d1142b832482da7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787823742.844320:0:16542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a03fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+14:2353:x1874668629914240:12345-192.168.202.35@tcp:4:dd.0 Request processed in 115757us (135354us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787823742.844338:0:16542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 2 00000100:00100000:2.0:1787823742.844377:0:16542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 5 00000100:00100000:2.0:1787823742.844390:0:16542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0ede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+13:2352:x1874668629914496:12345-192.168.202.35@tcp:4:dd.0 00010000:00010000:2.0:1787823742.844437:0:16542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000889cae85/0x5d1142b832482dbc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.844458:0:16542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823742.844463:0:16542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787823742.844470:0:16542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000889cae85/0x5d1142b832482dbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787823742.844513:0:16542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000889cae85/0x5d1142b832482dbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787823742.903050:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:3.0:1787823742.909215:0:15005:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 6291456 00002000:00010000:3.0:1787823742.909313:0:15005:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 12295 00010000:00010000:3.0:1787823742.909331:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbb49a0d/0x5d1142b832482dae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.909345:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fbb49a0d/0x5d1142b832482dae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.909355:0:15005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fbb49a0d/0x5d1142b832482dae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.909363:0:15005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26de00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:3.0:1787823742.909368:0:15005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbb49a0d/0x5d1142b832482dae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.909378:0:15005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbb49a0d/0x5d1142b832482dae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.909400:0:15005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fbb49a0d/0x5d1142b832482dae lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.909407:0:15005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fbb49a0d/0x5d1142b832482dae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823742.909533:0:15005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+15:2353:x1874668629914368:12345-192.168.202.35@tcp:4:dd.0 Request processed in 82997us (191372us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1787823742.909546:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 3 00000100:00100000:3.0:1787823742.909582:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 6 00000100:00100000:3.0:1787823742.909600:0:15005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+14:2352:x1874668629914752:12345-192.168.202.35@tcp:4:dd.0 00010000:00010000:3.0:1787823742.914890:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c5dc53a/0x5d1142b832482dc3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.914915:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787823742.914919:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787823742.914927:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c5dc53a/0x5d1142b832482dc3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.914941:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c5dc53a/0x5d1142b832482dc3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787823742.952457:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00000100:00100000:2.0:1787823742.955347:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a0ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b00b7bac-c389-4a58-8ac8-b4f04764fb77:3306:1874668651915904:0@lo:400:kworker.0 00000100:00100000:2.0:1787823742.955424:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823742.955468:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874668651916416:0@lo:400:kworker.0 00000100:00100000:2.0:1787823742.955495:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823742.955532:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787823742.955538:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a76ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874668651916288:0@lo:400:kworker.0 00000100:00100000:2.0:1787823742.955561:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823742.955590:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a0efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651916032:0@lo:400:kworker.0 00000100:00100000:2.0:1787823742.955615:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823742.955635:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787823742.955640:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a76fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874668651916160:0@lo:400:kworker.0 00000100:00100000:2.0:1787823742.955660:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823742.955693:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651915904 00000100:00100000:2.0:1787823742.955700:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651915904 00000100:00100000:2.0:1787823742.955742:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787823742.955751:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79100ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+19:3306:x1874668651915904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823742.955815:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79100ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b00b7bac-c389-4a58-8ac8-b4f04764fb77+19:3306:x1874668651915904:12345-0@lo:400:kworker.0 Request processed in 65us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823742.955822:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787823742.955855:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651916416 00000100:00100000:2.0:1787823742.955868:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651916416 00000100:00100000:2.0:1787823742.955903:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651916288 00000100:00100000:2.0:1787823742.955906:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651916288 00000100:00100000:2.0:1787823742.955919:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651916160 00000100:00100000:2.0:1787823742.955922:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651916160 00000100:00100000:2.0:1787823742.955934:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787823742.955939:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a283840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874668651916416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823742.955973:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a283840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874668651916416:12345-0@lo:400:kworker.0 Request processed in 33us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823742.955979:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787823742.955991:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787823742.955997:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a281e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874668651916288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823742.956023:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a281e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874668651916288:12345-0@lo:400:kworker.0 Request processed in 26us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823742.956029:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787823742.956039:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787823742.956045:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a280780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874668651916160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823742.956076:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a280780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874668651916160:12345-0@lo:400:kworker.0 Request processed in 31us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823742.956082:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787823742.956104:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651916032 00000100:00100000:2.0:1787823742.956108:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651916032 00000100:00100000:2.0:1787823742.956135:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787823742.956141:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a282d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651916032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787823742.956168:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a282d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651916032:12345-0@lo:400:kworker.0 Request processed in 29us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823742.956174:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1787823742.956204:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787823742.956208:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787823742.956249:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a76fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874668651916160:0@lo:400:kworker.0 00000100:00100000:2.0:1787823742.956261:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a0efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651916032:0@lo:400:kworker.0 00000100:00100000:2.0:1787823742.956289:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a76ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874668651916288:0@lo:400:kworker.0 00000100:00100000:2.0:1787823742.956297:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a0ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b00b7bac-c389-4a58-8ac8-b4f04764fb77:3306:1874668651915904:0@lo:400:kworker.0 00000100:00100000:2.0:1787823742.956305:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874668651916416:0@lo:400:kworker.0 00000100:00100000:2.0:1787823742.959152:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787823742.959176:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651916544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787823742.959257:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787823742.959306:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651916544 00000100:00100000:2.0:1787823742.959314:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651916544 00000100:00100000:2.0:1787823742.959363:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787823742.959372:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a0ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651916544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787823742.959394:0:15003:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 69795840 pending 1703936 free 3859808256 avail 3851419648 00000100:00100000:2.0:1787823742.959439:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874668651916544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823742.959446:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787823742.959485:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1787823742.959491:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e792ec4d680, transno 8589934595 00000004:00080000:2.0:1787823742.959515:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1787823742.959543:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874668651916544:0@lo:13:osp-pre-1-0.0 00002000:00010000:3.0:1787823742.960819:0:16542:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:3.0:1787823742.960829:0:16542:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:3.0:1787823742.960845:0:16542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000889cae85/0x5d1142b832482dbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.960859:0:16542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000889cae85/0x5d1142b832482dbc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.960868:0:16542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000889cae85/0x5d1142b832482dbc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.960874:0:16542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e79358d3800 already unused, calling callback (ffffffffc1649440) 00010000:00010000:3.0:1787823742.960879:0:16542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000889cae85/0x5d1142b832482dbc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.960902:0:16542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000889cae85/0x5d1142b832482dbc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.960925:0:16542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000889cae85/0x5d1142b832482dbc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.960935:0:16542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000889cae85/0x5d1142b832482dbc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787823742.961022:0:16542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0ede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+12:2352:x1874668629914496:12345-192.168.202.35@tcp:4:dd.0 Request processed in 116633us (242848us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1787823742.961030:0:16542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 5 00000100:00100000:3.0:1787823742.961059:0:16542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 7 00000100:00100000:3.0:1787823742.961073:0:16542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e793a03c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+11:2352:x1874668629914880:12345-192.168.202.35@tcp:4:dd.0 00010000:00010000:3.0:1787823742.961111:0:16542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbb49a0d/0x5d1142b832482dca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.961124:0:16542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787823742.961129:0:16542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787823742.961135:0:16542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fbb49a0d/0x5d1142b832482dca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787823742.961147:0:16542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fbb49a0d/0x5d1142b832482dca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823742.970349:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d741ea82/0x5d1142b832482db5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823742.970370:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d741ea82/0x5d1142b832482db5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823742.970380:0:15006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d741ea82/0x5d1142b832482db5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823742.970387:0:15006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a40fe00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:1.0:1787823742.970392:0:15006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d741ea82/0x5d1142b832482db5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823742.970402:0:15006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d741ea82/0x5d1142b832482db5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823742.970424:0:15006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d741ea82/0x5d1142b832482db5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823742.970432:0:15006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d741ea82/0x5d1142b832482db5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823742.970545:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a0ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+11:2352:x1874668629914624:12345-192.168.202.35@tcp:4:dd.0 Request processed in 141746us (252332us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1787823742.970556:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 4 00002000:00010000:0.0:1787823742.993086:0:15005:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00010000:00010000:0.0:1787823742.993112:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c5dc53a/0x5d1142b832482dc3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.993141:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c5dc53a/0x5d1142b832482dc3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.993150:0:15005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c5dc53a/0x5d1142b832482dc3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.993158:0:15005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26d000 already unused, calling callback (ffffffffc1649440) 00010000:00010000:0.0:1787823742.993163:0:15005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c5dc53a/0x5d1142b832482dc3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.993172:0:15005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c5dc53a/0x5d1142b832482dc3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.993194:0:15005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c5dc53a/0x5d1142b832482dc3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787823742.993203:0:15005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c5dc53a/0x5d1142b832482dc3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787823742.993374:0:15005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+11:2352:x1874668629914752:12345-192.168.202.35@tcp:4:dd.0 Request processed in 83772us (266994us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787823742.993387:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 6 00000001:00080000:0.0:1787823742.993866:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00000001:00080000:3.0:1787823743.036797:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00002000:00010000:1.0:1787823743.037110:0:16542:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:1.0:1787823743.037130:0:16542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbb49a0d/0x5d1142b832482dca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823743.037144:0:16542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fbb49a0d/0x5d1142b832482dca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823743.037153:0:16542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fbb49a0d/0x5d1142b832482dca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823743.037160:0:16542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e793a26de00 already unused, calling callback (ffffffffc1649440) 00010000:00010000:1.0:1787823743.037165:0:16542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbb49a0d/0x5d1142b832482dca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823743.037174:0:16542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbb49a0d/0x5d1142b832482dca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823743.037196:0:16542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fbb49a0d/0x5d1142b832482dca lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787823743.037204:0:16542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fbb49a0d/0x5d1142b832482dca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787823743.037429:0:16542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e793a03c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+5:2352:x1874668629914880:12345-192.168.202.35@tcp:4:dd.0 Request processed in 76356us (310891us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787823743.037439:0:16542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 7 00000100:00100000:0.0:1787823743.466195:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787823743.466231:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e793a03cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651916672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787823743.466325:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787823743.466591:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668651916672 00000100:00100000:1.0:1787823743.466600:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668651916672 00000100:00100000:1.0:1787823743.466656:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787823743.466667:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651916672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787823743.466706:0:15003:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787823743.466781:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874668651916672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823743.466789:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787823743.467054:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e793a03cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874668651916672:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787823743.858301:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787823744.864505:0:16582:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1787823744.873943:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787823745.222307:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823745.222345:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823745.222377:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823745.222416:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787823745.222447:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629915264 00000100:00100000:3.0:1787823745.222455:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629915264 00000100:00100000:3.0:1787823745.222522:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629915776 00000100:00100000:3.0:1787823745.222525:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629915776 00000100:00100000:3.0:1787823745.222546:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 15 00000100:00100000:3.0:1787823745.222554:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+5:2353:x1874668629915264:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787823745.222617:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+5:2353:x1874668629915264:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 65us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823745.222624:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 15 00000100:00100000:3.0:1787823745.222645:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 16 00000100:00100000:3.0:1787823745.222651:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fe458d9d-d7c9-49e7-b833-d87e1bb29306+5:2353:x1874668629915776:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787823745.222669:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fe458d9d-d7c9-49e7-b833-d87e1bb29306+5:2353:x1874668629915776:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 19us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787823745.222675:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 16 00000100:00080000:3.0:1787823745.222688:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787823745.222692:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787823745.223320:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629915008 00000100:00100000:0.0:1787823745.223328:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629915008 00000100:00100000:0.0:1787823745.223372:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 121 00000100:00100000:0.0:1787823745.223380:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e79100edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+13:2353:x1874668629915008:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787823745.223421:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e79100edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0284c747-3fb5-4c50-9b22-d854f5cdb6b4+13:2353:x1874668629915008:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 42us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1787823745.223428:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 121 00000100:00100000:1.0:1787823745.223595:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629915520 00000100:00100000:1.0:1787823745.223599:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629915520 00000100:00100000:1.0:1787823745.223659:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 29 00000100:00100000:1.0:1787823745.223666:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792ec4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe458d9d-d7c9-49e7-b833-d87e1bb29306+6:2353:x1874668629915520:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787823745.223711:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792ec4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe458d9d-d7c9-49e7-b833-d87e1bb29306+6:2353:x1874668629915520:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 46us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823745.223717:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 29 00000100:00080000:2.0:1787823745.223790:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787823745.225570:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823745.225611:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787823745.225656:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787823745.225714:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629915136 00000100:00100000:2.0:1787823745.225738:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629915136 00000100:00100000:2.0:1787823745.225823:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 30 00000100:00100000:2.0:1787823745.225832:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+20:2352:x1874668629915136:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787823745.225923:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+20:2352:x1874668629915136:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 91us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787823745.225930:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 30 00000100:00080000:2.0:1787823745.225956:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787823745.235109:0:16261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629915392 00000100:00100000:1.0:1787823745.235125:0:16261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629915392 00000100:00100000:1.0:1787823745.235220:0:16261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874668629915648 00000100:00100000:1.0:1787823745.235224:0:16261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874668629915648 00000100:00100000:1.0:1787823745.235259:0:16261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 17 00000100:00100000:1.0:1787823745.235270:0:16261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+5:2352:x1874668629915392:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787823745.235350:0:16261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d7e3b57-4f07-412f-99dc-6b89e11a87ce+5:2352:x1874668629915392:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 82us (9737us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823745.235373:0:16261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 17 00000100:00100000:1.0:1787823745.235390:0:16261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 18 00000100:00100000:1.0:1787823745.235397:0:16261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e792e80d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fe458d9d-d7c9-49e7-b833-d87e1bb29306+5:2352:x1874668629915648:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787823745.235424:0:16261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e792e80d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fe458d9d-d7c9-49e7-b833-d87e1bb29306+5:2352:x1874668629915648:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 28us (9768us total) trans 0 rc 0/0 00000100:00100000:1.0:1787823745.235430:0:16261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 18 00000100:00080000:2.0:1787823745.236579:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787823745.236585:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787823745.905646:0:15517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29562 lines, 29562 kept, 0 dropped, 0 bad.